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]NTiit)i.)iJi.:T:iON 

Till' discriminat ion of ;i vaivloly of paired mli'i'or iina[;o sLii,:uli has 
been studied by cxjum* i liUMit a 1. |)Syc:ho.loj; i s I s for somo Linu', ]nfrahui;ian 
animals, prcischool children, relardod chlldi'cn and normal and abnormal 
atlulLs havo all bocn subjuctri. JnLorosL in usin^; mirror iinaj^.o fiLiiiuili 
v/iLli Lhcvio dLffLrrt.'nl su];joc:t: j;roups has rcsulLed fro::i a \rldc. variety of 
difftTcmL ru.scaiTh quos Lions boiiig asked eoncernin[», discrimination ])ro- 
cosseti. 

I'or example, Jc-ffrey (1958) ohsorvctd that: many four-year-olds did 
not easily acquire a leTt-ri^^hL orienied (mirror ima^.c) discrinination 
b e I \s\\Ci\ t V ; o s i 1 c- j-» (• i mu 1 1 . ] > y ad cl i n g a m o t o i: r e c; p on so to the c h i 1 d ^ s 
repertoire prior to the final criterion rosiionsc, he was able to Gi[^;ni- 
ficantly increase the proportion of children that acquired the discrim- 
ination. *J1ie use of this procedure by Jeffrey v;as a r'c^sult of his 
interest in the area of media tional theory of human conceptual develop- 
ment; in this case mediated discrimination. 

Bijou (196S) also used mirror image stimuli in a study that inves- 
tigatod fading and stimulus shapinj;^ procedures to achieve near errorless 
discrimination acquisition, }Ii s interest was in investigating program- 
ing procedures that v;ould result in very few or no errors during tlic 
acquisition of a difficult discrimination.- 

Although both of the above experimenters used mirror image stimuli 
in their studies, neither was primarily intc?rested in the study of tlie 
stimuli per sc. Rather, it w^ould appear that bol:h used the stimuli 
because they tend to produce high error rates in preschool and retarded 
children. Subjects tend to respond to the mirror image match as fre- 
quently as to the direct (same) match of a sample stimulus, 
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A ''r,otul'' tcsi. oT a liMchini* proct^liivt' v.Muld Uumi be l:u obiU'i'V^' how 
sucH'i'j'sf u L It: VMS in ri'.diiciu); llu'wc mirror incij'.o inal.clu;}; , Tliu.'s , (^biU)rv- 
iui\ \u)\! .-uil-^Joot n a(:(iuiri' a d i f f i.cu 1. 1: d I r.O'.iiiiinal ion iiiulor difforcMit: 
Lrainin^'; comli t i (mk; i:iny j;oparato lucdi.ocro .fra;n h ii'.^^^y 'inccos^if ul proco- 

}joL1i Llio Ivijou and Joffr^'y !'»t.uclics roprosonl tv.'o areas of olii.ld 

dovcJ opiiUMiL LIkiL liavo hcv.w of .interest: to exper J.nicnt ors for some yo.arrj. 

In sovor,*il 5;Liidic\s v/hei-c a vo.rbal. or motor (,'.;uch a.s in the Jt.:ffr(*y 

iU:tu!y) rosponj^o v;a.s added to a cdiain thai c:ul;n.lna I cd :i.n the f;i.iKil cri- 

Wcric^n rosponsci, the acquis j I ion or rrca].l. of a d iscr iTniiiat ion v-'a/i 

facil itatod (llaj-ou and IC in 1 (.■ y , 19G8; Lov.it t and Cin.'tinri, 1968; \'c'.ir 

and Slc!Vt::nson, 1939). Another f-ierios of Taodio/.^ hai^ also invcsti[;,ated 

the .adv.-;nta[ioi; of adding a verlml response to the subject* s reporLoirc. 

Ilov-'cver, instead of requirin^^, Jt during the learninj^^ process, as in the 

/I 

fitudic^s previously uieutioned, it is trained separately and before the 
training; on a final discrimination or transfer task (Cantor, 1955; 
Norcror-s and Spikcr, 1962; Shepard, 1956). 

A more recent series of investigations on teaching procedures used 
in errorless stimulus control studies have begun to suj^gcst that a tech- 
nology nay be develo]>ed vjhereby precise control of responding is possible 
through the arrangement of stimuli. Bijou (1968), 5^idinan and Stoddard 
(♦1967), Moore and Goldiamond (1964), and Touchetto (3 968) have donon-- 
strntcd tliat fading, superiinposition and stimulus shaping procedures 
applied to stimuli in the child *s learning environment will facilitate 
the acquisition process. 

The studies that have used programing or errorless stimulus control 
procedures have been by scientists who usually accept the more empirical, 
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opfr.'uit or lu'liavjoral nppi o.ic'l) to iAw .'U.udy of lM»ynIu»] quo.^'it Jons. 

Thry \.\>ul(l uul :\rA\vl\n' In ])rt)po:vI I Icu) that (TFoni iwv lU't'uy ry 
(i.cs, nul>J^'i.M: must r('{.|UMul to t lio S-) ;in order Tor nciju I sJ t Jon to 

occin*. 

Tliu |>;:ychuJ i.iai^ \<ho lu'tvo f,u.mlit;cl tlia crfecls of Vt.!rlj.*rl prclrain- 
Inj; or iho t^ficcls oT /hKIftl motor or verba] rcr.i)on;u>y cUirlnj; ncqui- 
r.i.Lioii procc'r^j^ are lu'iially i;:oro L]u»orcM..lcal in lliolr or J ont at: I on . V/llh 
tlK.* liolp of Int l: i-yon j ai» varinhj.os tliey aLloinpL locxplaln cS-K acquitiJ.-^ 
I. ion t hi'oi4;h Lnlri b itilou (l lio result of no rov/arJ v;]icn S- ±r, rcsi^ondcd 
Lo) anil otiior proccH.-'OS . , . 

'ila- Lht'orel .1 cal (or .lac]; of at) a]^proac]) to tiljc stiiuly of learning 
l)y t:bo;-.e l:v;o gnMips rcmulljii in raLlicr diffcjrenL procoduros lu'ving invos- 
t: j.i'?,ri,c^cl v;J^':n acqu.i r.J.L icai ii> under con^^ :i dornt ion . In ^^one.ral, tlioro hus 
becMi no luiric:^ of st:udic:ij published wlicroby bot:ii procedurer. liave ])ecn 
conb.ined Lo aid in L'lie acquisiLion of conce.pt:ual problcns. "Pro{;ramers*' 
often tliink in tcim>;s of lengtrdiy faeries of pro{^ra;ns, each independent, 
yet building upon one another to £iccoinpl isli aouie desired criterion be- 
havior. Trial and error jv^ycliologists on tlie other liand tend to use 
simple, little training procedures tliat cut dovn to some extent tlie 
len^.thy trial and error process usually needed to obtain acquisition. 

The present study is an outgrov/tli of an investigation (Werner, 1971) 
that resulted in a program for teacliing a lov;er case b - d discrimina- 
tion to i^resclioo] children. This is a very difficult discrimination to 
learn for this" a[;e subject and f urtherii^ore is an example of the mirror 
ima^e prohleia if tlie d is present as a possible match vlien b is tzhe 
sample stimulus in a matclv-to-sample format (and vice versa). 

V/erner's program was most successful when she added a verbal 
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response (in a chain of responding) before the final critcr'ion response 
of pointini^ to tv;o stimuli (ex. the sample 'b' and the match 'b') \:hen 
one of the other matches was a 'd'. Tlie program utilized a variety of 
fading and stimulus shaping procedures. Although tlie program was 
fairly successful for a random group of children chosen for study, there 
v^erc still some difficulties v/hen the verbal label vjas being tauglit dur- 
ing the progr^lm. Attending to the "rule-of -thumb" of not teaching two 
things at once when programing, it v;as decided tliat a pretraining pro- 
gram could bo developed that tauglit the verbal response to the child 
prior to the b and d prograir.s. 

The present study v:ns therefore primarily concerned with investi- 
gating procedures that vould teach a difficult mirror image discrimina- 
tion to preschoolers. Of intereri^t also v;as the study, of the effect of 
a prograr^mod lu-ctraining procedure. The procedures involved a verbal 
resj-jonse to be acquired prior to the acquisition of a visual discrimi- 
nation. Variations of these tV7o aGquisltion processes were also carried 
out and compared. 
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METHOD 

■ «*v .. . . 

Subjects 

Eiglitcen children vrho ranged in age from 3ry.rs 3~raontlis to 5-yrs 
6-inonths v:ero. identified throngh pretests to be responding at chance 
level on a b-d (lower case) match-to-sample discrimination problem. 
They attended the Ildiia A. Hill Child Development Prescliool Laboratories 
in the Dapcirtncnt of Human Development at chc University of. Kansas, The 
study v;as conducted in an experimental room near the preschool class- 
rooms, Tlie daily ser>cn'.on£; larited between five and tliirtcen minutes and 
Die total experiment for any^one cliild took 17 days. After receiving 
two days of pretests, the subjects were placed in four groups on tlie 
basis of their pretest scores, their ages, and sex. Tlie four groups 
were arranged so tliat each group's mean or ratio was as similar as pos- 
sible to the other three groups. The mean ages; the distribution of the 
male/female ratios; and the average of the two pretests for each of the 
four groups are found in Table 1. 

Insert Table .1 About Here 

D esig n 

The four groups studied in tliis design were created from what oc- 
curred during both tlie preliminary labeling (story) 'program and the 
sii-bsequent h and d programs. Two of the groups .had only to sit (and 
hopefully '^listen") while the story was read to them. The other two 
groups had to point upon the experimenter's request to each one of the 
stimuli (characters in the story) about whom the story was being read. 
One of these tv7o groups also had the additional requirement of emitting 
a verbal refrain prior to pointing tliat included the names of the 
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characters in the story. The nul)jects were also divided into tv;o groups 
accordin^i to v;hat v/as arranged for the.in on the b and d programs which 
follov;ed the story. One group (required verbalization) was required to 
label either the b or the d (depending on v»^hich was being progranined at 
the moment) v;hen the pointing response v;as also made to the sample or 
match stiinulus. The otlier group did not label the stimuli, and simply 
pointed to the sample and matches. The effects of these various condi- 
tions vjcre analy;^ed by comparing pre-post and probe tests across 
acquisition for the follov^ing four groups: 

Story ]^ro^ /. ram b and cl prc»t? ram 

1 . verbal refrain required verbali^:ation 

2- sit required vcrbali^iation 

3. sit no- required verbalization 

. point , no-required verbalization 

The sequence of: events for each of the four groups across all tests and 
programs is summari zed in Table II. 



Insert Table II About Here 



Both group (trend analysis) and individual analyses (subject curves) 
wore possible from the data due to the use of repeated probes (same as 
pre and posttests) during the acquisition process. -Subject performance 
during programs was also collected and graphed by group and individual 
means. 
Apparatus 

A TMI GROLIER Min/Max II teaching machine which the subjects v/ere 
trained to operate themselves v;as used for all sessions except v;hen the 
story was read. The machine was altered so the window through which the 



stimuli -were displiiycc! v;as increased by one inch vertically. The ma- 
chine v/as placed to the left of the experimenter and directly in front 
of the child on a snial] table. 
Materials 

Pretest - Probes - Posttest 

All tests consisted of 12 items that required a lov;cr case b and d 
discrimination. Each item was presented in a match-to-sample format. 
The letters v:cre typed in primary type size. Six b's and six d's v^ere 
presented as .samples and randomly distributed "across tric.?ls, VJhen the 
correct match was a b, one, of the tv;o distractors VJas a d and vice versa 
The otlier letters used as distractors v/ere p, g, i, e, and c. Tlie posi- 
tion of the correct choice v;as varied so each horizontal position v;as 
connect an equal number of times. The pre-post and probe tests liad tv.'o 
formats. One was simply '.cverse order of item presentation of the 

other. The tv;o forms were used to avoid any subject memorizing a pat- 
tern of correct responses. One of the forms of the test is included in 
Appendix A. ' 
Story Program: . ' 

Story program (verbal refrain group) 

Subjects were introduced to two refrains, each being associated 
with a particular character in the story. When the experimenter read 
about a character, the subjects v;ere required to verbalize the refrain ' 
at a specified time while pointing to the character. 

The pages on which the characters appeared (alw^ays one per page) 
were randomized so that one character did not alv;ays appear on the same 
side of a page. Also the page on which the subject was first required 
to look was not always on the left. This procedure was implemented so 
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that the .subject: might tend to look at the characters on both the left 
and the ri[;ht pages bofore a pointing response was mcide. 

Incorrect pointing responses to a character were corrected. The 
correction procedure involved telling the subject v;hich one was correct 
by saying, "This is the one." A 90% criterion for receiving the toy v:as 
used each day. 

Story program (point-no-ref rain..,group) 

This group had tlic same materials, correction procedure and criter- 
ion for reinforcement as the verba], refrain group. However, they v;erc 
not required to omit the verbal refrain whicli was read to thern; they 
v;e re only r e cj u i. red to p o in t . 
Story program (sit group) 

Ther.e subjects v:ere told to sit quietly in the chair v;hile the 
story v:as read. They v.-eiic not^required to emit the verbal refrain or 
point v;ltilo looking at the pictures. They v;erc told if they sat quietly 
they vxrald receive their toy at the end of the siiission. 

The pictures used in the story, the story prose and the data sheet 
are included in Appendix B. Each numbered item refers to one picture 
(except where noted on the data sheet) . The verbal refrains for the 
pictures were: "Uh huh," says Mother Duh; and "VJee gee," says Bonghy- 
Bee. 

b program 

This program presented b as the Scimple stimulus throughout the ^5 
items. The position of the correct choice was randomized appearing in 
the three positions an equal number of times. One distract or was d and 
the other was a made-up figure. A criterion of 90% was in effect to 
receive a toy. A correction procedure was used for each incorrect 
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rcsponjjc by telling the subject the correct response. Program b and the 
data r.hcct can be found in Appendix 
d program 

The sample stimulus v;as d throughout the items of this program. 
One distractor v/as b and the other was the same made-up figure used in 

» 

the b program. The correct choices were random as in the b program. 
The criterion and correction procedure w-ere also the same. The d pro- 
gram is also included in Appendix C, 
Combination program •.• ' 

This program v7as the first time, on other than all tests, that both 
b and d items were interchanged and used as sample stim.uli. The random- 
ization, correction procedure, dis tractors, instruction and criterion 
V7cre the same as on the two previous programs. The combination program- 
item?; are found in Append«.x 1) (only the b program is shown)-. 
Recall of verbal label 

The recall of verbal label consisted of five lower case b^s and 
five lov;er case d*s individually and randomly presented. Each was of 
primary type in the middle of a card. The order of occurrence of the 
single b and d letters used for the recall of verbal labels is found in 
Appendix E, Incorrect responses V7ere corrected by the experimenter 
telling the subject what the correct stimulus was, • 
Procedure 
Pretest 

Each subject was given two days of pretests. The second day's 
items v;ere the first day's in reverse. On the first item of the first 
day, the subject was instructed to '-Point to this one," with the experi-- 
menter indicating the sample with her right index finder .under the 
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s.'.iinplc. ' The subject was t:lion iustructod to, "Find another one like it 
over here" v^hLle the experimenter ran her finger along tlie top of tlie 
match choices and landed a])ove tlie correct clioice. In tliis manner, the 
subject v;as cued as to tlie response required of him. The instructions 
for the remainder of the pretest were identical witli no cues from tlie 
e>:parir:onter . Eacli correct response wns followed by a- token and praise. 

VJiien a subject made an incorrect clioice, the experimenter made some 
comment sucli as, "That was a good try," or "That's fine," but no token 
was delivered. Tliere was no correction procedure. A criterion of 50% 
correct on tlie pretest was.u^ed for each subject to receive the toy he 
had chosen before tlie session. The experimenter determined wliat 50% 
v;ould h.e before each session and placed that number of tokens ivt her cup 
The subject was informed at the beglnninj?, of eachi session tliat he needed 
to get all of the tokens from the experimenter's cup to his cu]-. to get 
the toy. lie received a red token if he scored less than 50% and the toy 
was placed aside to b3 v:orked for at tlie next session. Tlic data sheet 
is shovn at the end of Appendix A. 
Story 

A story which took 5 sessions v:as then read to all subjects follow- 
ing the pretest. The story was in an IIU in. x 10^5 in. hardback note- 
book. After the characters in the story were introeluced, a fading 
procedure was begun. The complexity as v;ell as the height of the char- 
actors were faded. They were 8U in. (Mother Duh) and 8 in. (Bonghy- 
Bee) in height at the beginning of the story and 3/^ in. at the end. 

The character Mother Duh v;as introduced on the first item. The 
nfiine of Mother Duh v;as chosen for the stimulus character w^hich was to 
become a d at the end of the d program. The short phonetic sound of the 
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lettor was chosen to conlirnsf V7ith Bonghy-Bec, The story told about tlie 
things Mother Dnh and her baby liko to do. On tlic fourth item, the 
second cliarncter, Bongliy-Bee , was introduced. The name Bonghy-Boe was 
chooen for the stimuJus character wliich became a b at tlie end of the b 
program, Tlie name is longer tlian Dull and ha.s tlie name instead of sound 
of the "letter. Since "bee" and "dee" sound alike, it is quite possible 
tliat this adds to tlie difficulty some cliildren liave in discriminating 
the visual b from tlie d, Tlicreforo, tlie "bee" and "dee" sounds were 
made as different as possible. The sliort phonetic sound duh of tlie d 
and the name "bee" of the b v;erc used to lielp accomplisli tliis. In addi- 
tion, the v;ord "liongliy" v/as used to add to the length of the "bee" 
verba] ization. The magic bong stick of Bonghy-Bce's that could make 
things disappear and re-appear was also introduced, Tlvis v:as tlie main 
theme of tlie story. On the sixth item, the way the magic bong stick 
\7o-rl:cd its m.agie was introduced when a bush disaj^peared , Items seven 
through ten saw Mother Duh's hat and ears and Bonghy-Bee's stomacli and 
-hands had disappeared. The fading on Mother Duh began from the top witl} 
her hat and moved down v/hile the fading on Bonghy-Bce started in the 

9 

middle and moved out, Thir^ was done to keep the fading on the two as 
different as possible. 

There was more fading of the complexity of the- characters on the 
second day of the story. Mother Duh\s nose, eyes, head, arm, hand, 
purse and tail faded, Bonghy-Bee's legs, arams and feet faded. When 
one character appeared twice on tvjo pages which v/ere facing each other, 
as in items 17 and 18, the experimenter cued which picture to point to 
by putting her finger on that page. 

Items 21 through 30 comprised the third day. Bonghy-Bee's collar, 
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his other arm, hat, eyes and nose were faded. Mother Duh's other arm 
and hand, chest, feet and logs faded as well as BabyDuh's ears and 
hands. 

On the fourth day, items 31 through 40, Baby Duh's eyes and riouth, 
plus Baby Duh and Mother Duh's pouch faded. Bon^^hy-Bee ' s ears, hair and 
mouth and head faded. The .complexity of tlie characters v?as completely 
faded by item 36. On item 37, Mother Duh appeared as she had at the be- 
ginning of the story as did Bonghy-Iiec on item 38. They both appeared, 
on items 39 and 40, with the complexity faded completely as they bad on 
35 and 36. 

Fading of tlie size of the character v7as begun and complected on the 
fifth and last day of the story. They v:ere faded by 2h in., 1^-2 in., 3/4 
in.,. ,3/4 in., 1 in., h in., % in., h in., and h in. until they were 3/4 
in. in height, the same as they would be at the beginning of the b and 
d programs. The story ended with the characters appearing as they had 
at the beginning, before any fading had occurred. This v/as done to make 
the adults reading it happier. 
Requ'red verba].iza tion group 

The refrain associated with the character Mother Duh v;as introduced 
on the first item of the }?irst day of the story. After the experimenter 
had said the refrain, she told each subject in this* group to help her 
say the refrain. After it was practiced several times together, item 
tv;o v;as presented. The experimenter cued each subj ect *v;hen to say the 
refrain on this item by saying, *'Nov7 you say it with me." The experi- 
menter faded her help on the refrain by fading her voice softer. Each 
subject was required to verbalize the refrain of 'Uh huh' says Mother 
Duh" at the end of each item in the story associated .with Mother Duh 
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while pointing to the* character. (Sea items marked with an astcrish on 
day one of the story data sheet at the end of Appendix B.) 

On day two of the story, the refrain associated wit!i J3onghy-Bce v/as 
required. It v:as introduced (the experiir.ontea- verbalized it aloud, her- 
self) on day one but not required until day two. The refrain associaLud 
witli Motlier Duh v;as not required on day two wliile the subjects were 
learning the new refrain. The same practice to z^qX the subjects to say 
the refrain was used. The refrain of " 'VJce c^e ' says Bon^3hy-Bee , " 
which' was said while pointings was then required on tlie items marked 
with an asterisk on day two of the story data sheet which is in Appendix 
B. 

Both refrains were required on days tliree and four. On day five 
(items '^il through 50) , tlie experimenter pointed to the ciuiracter Mother 
Duh and said, "Say Duh." While pointing to Bonghy-l^.ee , she said, "Say 
Bongliy-Bee. " Therefore, the subjects said the names as they pointed to 
the character that was indicated by the experimenter. This was done so 
tliat the pointing and' naming of the stimuli would be. similar to tlie pro- 
cedure used in the b and d program.s. 

At the beginning of each story session, the experimenter asked each 
subject if he remembered Bonghy-Bee, Mother Duh and Baby Duh and the 
game they were playing. Thi^;. was done to be sure the child was ready to 
begin the session. 
No-requJ.red verbali'zation group 

For this group, v/hen the experimenter told them to point to a spec- 
ified character, they were required to do so. Ultimately the experimen- 
ter faded the request to point and each child initiated on his own. The 
experimenter said the refrain tlirougliout the story. 
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Sit group 

The story v;as read the smwe way" it was for the no-required verbali- 
zatj.on [;roup but no pointing to cither cliaracter was requested. The 
only requirement of these subjcicts v/as to sit in the cliair wliilc the 
story v.MS read. 
Probe one 

In the session following completion of tlie story the first probe 
was given. Tills was tlie same test as day one of the pretest. No ver- 
ba.! labels V7ere required. Tlic subjects were given the same instructions 
as were used on the pj'etcst arid the 50Z criterion to receive a toy was 
. also the same, 
b or d program 

Half of the required verb all/, at ion group and lialf of the no-required 
■verbalization grcup v;as given tlie b progrriT: first while the other half 
was given the d program. Each program took tv;o sessions witli items 
in a program. 

At tlic beginning of botli . programs , cacli subject was asked v;hether 
the saraple vjas Hongliy-Bee or Duh. Tliey were then instructed to, "Poiut 
to this one," wliile tlie experim.enter also pointed to tl)e sample, and then 
to-, "Find anotlier one like it^" A criterion of' 90% correct was used 
eacli day to receive : toy. 
K e q u i. r e d v e r b a 1 i. z alien group 

These subjects were required to point to the sample and say either 
Dull or Honghy~]3ee (depending on the program) and then find the correct 
match and also verbalize. 
No-required verbalization group 

These subjects v/ere not required to verbalize but to o.^ly point to 
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the; sample and tlie correct Tnatcli stinu] us . 
b program 

Tlie b v;as presenicd in Lhe firsU if.cm as it: appeared at the end of 
the story, 3/^» in. lii^h and one in. wide. On items two throuch five, 
the dxstractors v/orc brou^^lit in completely. The v;idtl; of tlie b stiniulus 
was faded by 1/8 in, on itcns 6 tlirou^^li 16. Iten 16 presented the 
sample as a 3/4 in. lower case b. The hciglit faded by 1/8 in. on 

items 17 tljrc;u^h 26, Tlie correct .stimulus was then the sixe of prir.ary 
tyj)a and the d dJstractor faded on items 27 through 37. The position of 
the 5;aniplo was tlien giradually moved from the center to the left side and 
do\:n to the same horizontal line as tlic^'. match sLinuli on items 38 through 
43. Tiie final 2 items were criterion bcliavior with the natch- to-sanplc 
fonri^bt , the sar-e as in the pretest. Pilot research in an earlier study 
(VJerner, 1971) harl indicated that an abrupt shift ^from a vertical fomat 
(where tlie sample is situated above the matches and in the middle) to_a 
horizontal format (the sample is located to the left clearly separated 
from the matches but on the same plane) on the match-to-saiiiple would re- 
sult in increased errors. Also, even though the vertical format appeared 
to be easier for children^, it was decided that the **best test" of u 
training procedure v;ould be to require the criterion behavior under the 
more difficult arrangement of the stimuli. Consequently, it v;as thought 
appropriate to train under the simpJ.cr vertical arrangement and then 
when acquisition had occurred to this point, slov/ly shift to the hori- 
zontal format, 
d program 

The.d program which used a different, fading procedure also began as 
the stimulus appeared at the end of the story, 3/4 in. high and in. 
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wide. The dintractorn v;crc faded in from itonis 2 throu['h 11. Beginnins 
on item 12 and ending on il.em 17, the stJiimli were faded by 1/8 in. 
They v7erc faded by 1/16 in. on items 18 through 25. The b distractor 
was then fcided to a lov;ar case b on items 26 througli 31. The rounded 
portion of the d stinaili v:as then closed on items 32 through 37. The 
sample stir.iulus then moved gradually to the left on items 38 througli ^i3. 
The last tV7o items displayed the stimuli in the same fonn as the pre- 
test. 

Probe" tv:o • . 

The second day's item>s of the pretest vere given for probe tv?o in 
the session follov.vLng completion of tlie first b or d progrcJin. Tliere v;as 
no verbal requirement and the 50% criterion was used. All groups re- 
ceived this probe in the same manner, 
b or d program 

Those subjects v;ho had received the b program previously now re- 
ceived the d program and vice versa. The 90% criterion was in effect. 
.The instructions remained the same as did the verbal label requirement' 
for the required verbalii:ation group. 
Probe three 

Day one of the pretest v.-as given the session follov/ing completion 
of the second program. All groups had the 50/.' criterion and no required 
ve rbal J >:a t ion . . 
Combination program 

This v:as the first: time, on other than pretests, that, b and d were 
both distributed across the session as samples. The program took tv?o 
days and a 90% criterion was used each day. 

The subjects who had finished the b program most recently received 



a (1 combination program. This procedure wns used becau.se the correct 
stimulus on tlie first 4 itcin.s v;as tlie one that hi\d been most recently 
trained. 

b and d combination programs 

Tlie positions of the correct stimuli and fading sequence v;ere tlie 
same on botli programs. Consequently, only tlic b combination program 
v.'ill be described belov;. 

The b sample on the first four items v.'as of primary type si^e. On 
items five through seven, the d sample began as 3/4 in. and faded l)y 1/8 
in. so it measured in- Anotlier 1/16 in. v:ns faded on item ciglit. The 
next tltree items had the b of primary type siy.e as tlic sample. Tlie d 
sample, on items 12 through 14 again faded by 1/16 in. The b V7as tl^e 
sample on the next tv;o items. On items 18 and 19, tlie d sample faded by 
1/16 in. Items 19 tlirough 21 had the b as sample. Tlie next tv7o i.tems 
(22,23) liad tlie d fade again by 1/16 in. v;ith item 24 tlie same height as 
23. Item 25 had the b as the sample v;liile item 26 had the d at 5/16 in. 
■The b v;as the saj:iple on items 27 and 28. The sample 29 and 30 v:as, a 1/4 
in. d. Two more b samples follov;ed v;ith a d sample on item 33 at 1/4 
in. Item 34 v;as a b with a d at primary type size on items 35 and 36. 
Item 37 x-/as a b and 38 and 39 were d\s. .Items 40, 42, and 45 had b 
samples and 41, 43, 44 were d samples. Therefore, both b and d v;ere 
used as samples to prepare tlie subjects for the posttest v;hen again they 
v;ould both be used as samples. 
Recall of verbal label 

The recall of verbal labels consisted of 10 4*' x 3** cards. They 
were shovm to the subjects one at a time im.medJately following the com- 
bination program. The instructions were the same on all .cards and for 
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both required verbalisation and no-roquix'ed v<irba.li2at:lon groups. On 
each card the cxperimcnlcr said, "Is this liongliy-jjcc or Duh?" There was 
a 50% criterion. 
Posttest 

Day tv;o of the protest v;as given to all subjects with a 50% criter- 
ion and no verbal requirement of any subject. 
Reliability 

An observer, viev:ing the e>:per:iinental sessions through a one-way 
mirror took reliability every day oiV one subject from the refrain- 
requirtid vc7-bali?^ation group and from the. point-no-required verbaliza- 
tion group. The observer recorded the same data as did the experimenter, 
(i.e., position of stimulus subject pointed to and its correctness.) A 
diff.ercnt observer toolc reliabilit}' every other day on a subject from 
the sit-no-required verb alii: at ion group and randomly throughout the 



study on the rest of the population. Reliabi].ity was computed by divid- 
ing the number of agreements of correct subject ^response by the number 
of agreements plus disagreements- 
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RESULTS 

Reliabilitiv 

Observer one wlio took rciliabill ty on the refrain-required verbnl-- 
ization group and the point-norrcquircd verbalization group obtained 99% 
reliability' with tlic experinicnter . The only source of consistent re- 
liability disagreement occurred for ol)servcr one on one day of the story 
condition. This disagreeineni: arof^e due to a confusion over vjhich stimu- 
lus tiie e>:peri?icnter ' y instructions and requests to respond to v7ere 
related. Observer tv:o v:ho took reliability on the sit-requlred verbal- 
ization and the sit-no-required verbalisation groups also olvtained 99% 
reliability v/ith the experimenter- No .systeinatic reliability clxr>- 
agreeinents v:ere noted (only isolated nnd scattered disagreements) with 
this latter ob .server. 

.Graphic: ^- Ggjlli'iLiljLjlil ^' treatFient ? ;rovj>s 

The results of the pre-post and test probes for all four tretitraent 
groups are graphed in Figure 1. The percent correct on the two days of 

Insert Figure 1 About Here . ' 

the pretest (botli pretest days V7ere combined under "pre") indicated that 
all four groups v;ere initially similar. Both the refrain-required ver- 
balization (daijhed line) and ' the sit-no-requ:i red verbaliiia tion (dashed- 
dot line) group had 53% correct; v/liile the point-no-re.quired verbaliza- 
tion (dotted line) and tlie sit-required verbalization (solid line) 
groupr; had 54% correct. 

Following the pretests, the story was read. The results of the 
story and the b and d programs are graphed in Figure 2. During the 
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InseTrl: Figure 2 About: Here? 

story program t:v;o groups were required to point to the appropriate 
character v;hile either the experimenter read the refrain (point-no- 
required verbalization) or v;hile the f^ubject emitted the refrain (re- 
frain required verbalisation). The percent correct for these two groups 
for pointing to the correct character v;as 96% for the refrain-required 
verbalization group and 92% for the point -no -required verbalization 
group. Ko percentages arc; shov^n for the other two groups since they 
v;ere only requirod to sit during the reading of the story and therefore 
no pointing response was cinltted. Besides data on the pointing response, 
data v;a7 also taken on correctness of saying each refrain in the story 
for .the ref rain-requircd verbalization group. Tliey all said th'fi correct 
refrain 100% of the time for each character each time that character 
appefjred in the story. 

Percent correct on the probe after the story (indicated as the 
first "probe" in Figure 1) shows that the different group percentages 
stayed the same or slightly decreased after the pretest. The sit- 
required verbalization group had the highest percentage at 54% follov.'ed 
by the sit-no-required verbalization group v.'ith 52% correct. The 
refrain-required verbalization group had 50% and the point-no-required 
verbalization group had 48% correct. 

On the first b or d program (Indicated as "b or d" in Figure 2) 
both the refrain-required verbalization and the point-no-required ver- 
balization group had 91% correct. The sit-required verbalization group 
had 90% while the sit-no-required verbalization group had 86% correct. 
These high percentages show near errorless responding in the programs for 
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all c^o^^P^* 

The pcrcenl: correct: on the probe afucr the b or d progrnm (i^.ndieatcd 
ns the middle, "probe" in Figure 1) shows a difference in hrouns. j'be 
refrain-required verbaliKation group had the hij^hest percentage at 63% 
(an increase of thirteen percent age points). Tlie point-no-required 
verbalization group had 5XC while the remaining tV7o groups (both of the 
sit groups;) had 48% correct. 

On the second b or d program (indicated as "d or b" in Figure 2) 
there is again indication of fairly 'successful responding witli all groups 
having 90% correct or above,.. The refrain-required verbalization group 
had 96% while the point-no-required verbalization group h;;d 93%. Both 
the sit-required verbalization and tlie sit-no-required verbalization 

group had 90% correct. 

The probe after the .second b or d prograu (indicated as the third 
•'probe'' in Figure 1) shov;s increasing percentages correct for all groupr^. 
The refrain-required verbalization group had 68% correct followed by 60% 
for the point-no-required group, Both the sit-required verbalization and 
the sit-no-required verba].ization group liad 56% correct, 

The percentages correct on the combination program are shown in the 
lov;er portion of Figure 3. The two required program verbalization groups 

Insert Figure 3 About Here 

are on the left half of the. graph with the tv;o no-required program ver- 
balization groups on the right. The words under the bars indicate tlic 
si' -y requirement. On the combination program, the refrain-required 
verbalization group liad 8/4% correct and the sit-required verbalization 
liad 59%. The point-no-required verbalization group had 72% and the 
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sit-no-ro,quired vcrbaliication ^^roiip had 58% c.orrocl:. The more succx;£is- 
ful rc{;pon(lin^;' on tlic combination program appciarod to be by those groups 
that point-ed (or i)ointed and verbaliiied) on the. fir-^t story program. 
Both groups that sat during that first program appeared to be operating 
just above chance on the combination program. 

At tlie end of the j^iocond day of the combination p.rograTii (day 16, 
Table II) another probe of the names of the b (Bonghy-Bee) and d (dub) 
v.'as made. The top portion of Figure 3 shows the percent correct on 
recall of thoije verbal labels. T'n.: 'two required b~d program verbalisa- 
tion groups: had the hxgb.er t percentages. The refrain-required verba- 
lization group had SOZ correct, follovjed by llie sit-required verbaTj na- 
tion group \.ath 53%. The pQint-no-requlrcd verbalisation group had A6% 
and the sit-no-required verbaliJintion group had 35% correct. 

The percent correct on the posttests (indicated as "post" on Figure 
1) show the largest differences between the four groups. The highest 
percentage is 89% correct for the ref rain-reouj.red verbalisation group! 
The point-no-required verbalization group and the sit~required verbali- 
zation group v/ere similar with 69% and 68% correct responses respectively. 
The sit-no-required verbalisation group was the lowest with 52% correct. 
'J'his latter group, therefore, showed.no change in performance since it 
b.ad 53% correct on the initi^il pretest. 

Just prior to tlie running of the b and d programs, each subject was 
asked the name of the character\:hich was the sample stimulus on the 
initial item of the program. The experimenter pointing to the sample 
stimulus asked each child v/hether that v;as "Bonghy-Bee" or "Duh". If 
the child was correct he was socially reinforced; if incorrect he was 
told which character it was. This response was recorded for each child 
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prior to Lhcjir first: ^mkI second (b or d) progrcims. Those data can be 
considered to be ))robo5 of label rec;ognition of the stimuli: config- 
urntJon.s at the point v;hen the story c • led and tlie program began. The 
percent correct for each group on recalling the verbal labels prior to 
the first (b or d) and second (d or b) programs is^ shov/n in Table III. 

Insert Table III About Uere 

Prior to the first program, tlie refrain-required verbalization group 
made 80X correct. Only one subject incorrectly labeled the sample 
stdmulus. A different subject incorrectly labeled tlie sample stimulus 
prior to the second program re5:ull:ing in 80% correct again scored for 
the second progran. The point-no-required vei'balixation group had the 
same 80Z correct prior to both programs. The sit~rcquired verbalisation 
group had 63% prior to tlie first program. This percentage increased 
prior to the second program to* 100% correct recall of the correct sample 
stimulus. Prior to the first program, the sit-no-required verbalisation 
'group had 50%. None of the subjects v:as correct (0%) prior to the. 
second program. The la^t tv;o groups deviated completely on this probe 
prior to the second program, v.-hereas they had been quite similar in 
their percent correct responding (63% and 50%) prior to the first pro- 
gram. The group that increased correct responding was required to 
verbalise on the intervening program, vjhereas the group that decreased 
to sero percent correct was not required to verbalir-ce. 
An alysis of variance (trend tests) of four treatmei i t groups 

Table IV is a summary table for the analysis of variance based on a 

Insert Table IV About Here 
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Lrcnul an:i.lysiti of the four ^^ruups (KdwarcKs , 1953). The grcnipr. (4) x 
prober; (6) iiiLcraction 5Uiov\'- lihorc va.s a fjignificant interaction across 
the. four j:;roupr, ft»r the six probe tests at less than the .05 level. 
Since a si t^uif leant interacCion v;as obtained then it would indicate that 
the different groups increased tlieir jK'rcent corre^ct across probe tests 
at different rates. This interaction v;as expected since the subjects 
v;ere initially selected (on the basis of their pretest scores) to be 
very similar botv.-een the four groups. However, the different prograin- 
in[j manipulations v;ere designed to differentially effect the different 
gronpr. across tlie probes. ' This would result in non-parallel trends and 
therefore an interaction effect. 

The suir.uuu'y tables sho::n in Table V were then done on all possible 

Insert Table V About Here 

two treatment group combinations after the interaction between the four 
groups v;as sliovrn. The significances by group combinations of each of 
the two groups are shown in Figure 4. The graph on tlie top left 

Insert Figure 4 About Here 

(refrain-required verbalisation and sit~no-required verbalization groups) 
sliows .a significant interaction (shaded section) betv7ecn the two groups, 
as dce.^: the suiiniary table (significance ^ , 05) for these groups (shov7n on 
the top table of Table V). A significant interaction was also shovm 
between the ref rain~requirc?d verbalization and point-no-required verbali- 
zat ion groups (second table in Table V and rdddle right graph in Figure 4 
Also the refrain-required verbalization arid the sit-required verbaliza- 
tion groups (third table in Table V and lower right graph in Figure 4) 

o a 
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coinj).'n:ison rc:.sul.t:cid in n *;.i.[^nif leant Jnler/icLJon nt; Tlicsc jncliv.!- 

dual coinparitions of the rcf raln~rcc]u i rrd vorhnlixaLion Ci.oup v;lt:h each 

of tljo other three groups Indicates thnt in all instances uhere v;as a 

•I 

si£\nif leant interaction involved. Th Li; .sugfjest.s that the refrain- 
required verbaIi:iation group was always significantly divergent (not 
parallel) acro.ss probes v/hcn compared to all other groui:)S. Since this 
group alvjnys had the highest percentage of correct responses from the 
second probe onv;ard , then it v.'ould appear that this group\s'rate of 
acquisition was faster than all other groups. 

The graph on the top right in Figure 4 and the suininary table at the 
top of tiie second page of Table V indicates thnt for these two groups 
theirc v;as a significant ( <C.05) probes effect. Hiis v:ould indicate that 
tlie .groups increased their percentages of correct responding signifi- 
cantly somewhere during the probes. The botton t\7o graphs on tlie right 
side of Figure 4 shov; no significances for any effects between the 
point-no-required verbalization and the sit-no-required verbalization 
groui)S (middle table on page 2 of Table V) and between the sit-required 
verbalization and the sit-no-required verbalization groups (bottom table 
on page 2 of Table V) , 
Individual su bj ect graphs 

Subjects A, D, and I of the refrain-required verbalization group 
in Figure 5 shovjed the typical "learning curves" on their probe tests 

Insert Figure 5 About Here 

as v.hey progressed through the study. All obtained posttest scores 
above 90% correct. Subject V increased across probes also but reached 
within the 80% to 90% range on the posttests. The only subject not 
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clcmonyLrat: i u|; acquisition in thlv group wn.v subject: P. Tlie progrniur; did 
not seem l:u he effective in licli)inj.» IvLm acquli'o the discrimination. 

The J ndividual curves for .'subjects in tlie ])oinl:~no~requircid vurb^i] - 
ixation i;roup (Figure 6) indicated that throe of the children (subjects 

Insert Figure 6 About Here ' 

Z, J, and K) did not acquire the discriniinat:i on v^hile one (VO did* One 
subject (11) slightly improved on the postte54t. These children never 
verbalised on either the story or the b or d programs and this complete 
]acl: of verb.'ilir^at ion may have resulted in t]ie program being successful 
for only cv.ie subject. 

The s it-required verbalization group sliovjed slightly different 
individu:il curves (Figure 7). Altliough none-"* of the individual children 

Insert Figure 7 About IJc^ro 

ci cq u ±rc. d the d i s c r i m J. n a t i o n as in the r e f r*a i n -r eq u i r e d v e r b ci 1 :i a t ion 
group, three. (E, Y, and M) of the four increased slightly across probes, 
indicating some acquisition. This group did verbalize on the b and d 
programs and these individual graphs may suggest that the b and d pro- 
gram verbalization is slightly more effective when compared vjitb the 
previous i>oint-no-required verbali/.ation group. All-Jiough the group 
graph of these tv70 groups (Figure 1) does not indicate any difference 
between rhcm, it may be that the different effects are in terms of the 
proportion of children in any one group tliat is mildly affected by the 
procedures. 

The group that showed the least number of individual .graphs where 
acquisition could be concluded v;as the sit-no-required verbalization 
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TiiKcr L Fj giirt"! 8 About Hero 



of conrcct ro>jpoinjc:i^ across prcilies or r>]i^ht:.1.y cl'.icren.scHl . Subject: 5] 

£;howccl a ,^^1 i.f;;hl. increnr^c; 1iov;cvcm:, the posttcust score v;ari still around 

chance rc^i^ponding. TheSDC subjectj^ had the least opportunity' to respond 

to e'itlier the story pro|;ram or the b and d pro^^ram and their behavior 
.seemed to reflect thiis. 
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DISCUSSION 

The rc^alll•s of lIku'j riLudy nccin t.o clearly dnclicata LhaL probably 
moMt prtMjchool cbiUlron could be CaughL Lhc ralber dif f J cirl f. d iscrJiui- 
nation of inaLcb iMg a M> * v;lLh a when VP iy one of Lhe ot:hcr inaLcbcs 
or distractors (and vice versa). However, iL is alr»o clear LhaL in 
order Lo Lcacli Lliii: discriininaLion the cbild musL: 1) actively enjiagc 
in the procedures by poinLina t:o picLurcij that inil/inlly are very dif- 
fereuL chai'acLers in a F.Lory; 2) learn n verbal label for Lbese cbarac- 
ters; 3) conLinue Lo apply Llie li^bel as the characters are sbaped inLo 
conf i^;urat:ions LhaL aL fir.yti. contain Lhe b and d buL barely resen;blc 
Lhe:n and laLer become Lhe .1el-t:ers throu[:.h fading; procedures; LhaL the 
verbal label should be acquired prior Lo Lhe discrimination of Lhc 
visual forms. 

The use of three oLher variaLdons on this ."paclccige" treatment ^;roup 
indicated that if any one of the abpve procedures v;as left out, that the 
proportion of the population that v;ould probab.Iy acquire the discriini- 
naLion v.'ould be appreciably reduced. ^ 

IL also appears LhaL mosL children, given tbe ^'package" of proce- 
dures InvesLigaLed j could acquire Lhe discriminaLion vnth very fev; 
errors. Tbe ^'J..«:.ual stimuli involved in the b and d programing procedures 
appear to be arranged in such a manner tbat most children made fev;er 
tlian lOZ errors on either progranj regra'dless of v;hich treatment group 
they v;ere in. however, the visual program itself was not sufficient to 
teach the discrimination. The child Vs behavior during the story could 
also be almost errorless as he learns the name that goes vnth the char- 
acters. But the story itself was not sufficient to teach the discrimi- 
nation. 
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The uju^ of probt* tcMs botvM'^Mi (:ho. v/n iodi: prt.ij;^'''''''' al.lowod the 
cf.IccL^:i of v<iri.ous proc:i*(lurr..s lo he nsscv^srvl ;k:: Lho child iu'Oj'r(';s.sc!cl 
l:hrouj;,h thv i-sperlmcnt . Vov OMaiiipl , the cffcci: of ihe Kfury on llio. 
tcriDinal d I sco':i m I nal ion rippt iirc:d lf» ho nun-o: J lUiaut r>lnco iho fii'si; 
probe? arr.ur Lhe prcLc'}.;!; s!u.)v;cd no ch:iu;-c! or cvc-n .slJc^^^ docrea.'jorj by 
each group. llov.'cvor, i:hv flrsl. check of lhe cliaraclori:;* unmar^ iii: I'ho 
be^l,innj.ng of l.he piroj'.raiii fol.lovrin^; Lht- .slcry :i nd;i caled l.hal; Che c^'c>ups 
v:ci'o diffc-rt'iU and IhaL tihosci v;ho jJoinLod lo or polnlcd Lu rind verl'jali/.ed 
r.he name in Lhe sLory pro;;rari had :-r';,iCHibu'red il i:nirly v;oll. Tho.sc 
ch.ndren v;hoi-^e boliavior \;ar Gitfinj:. durJn<'; llic slory 5diov:ed Moinc memory 
for Llio chrfracLcr^i^ nauu'.'.' ' but, only for about: half of l:hc subjocts in 
idiose t:wo f.roiips. Thci use of probo.s on boldi l:he cr:iler:ion beliavJ-or (lhe 
dist:r.lminal::Lcn of l:hc b and d) and on .smaller sogmanl-s of behavior (lhe 
verbal label of the* difforenl charaelerji) allows a more confidenl inter- 
prolalion of lhe variabiles rcr.ponr^;i ble for lhe irear.menl differences. 
The u.sG of ihesc probes al.so poJnls out Chat: a LcsC of only criLerion 
beliavior will nol necessarily reveal partial scquisilion of those re- 
sponset; lliought to contribute in some vay lo the final criterion retiponsc. 

The least" JUiecGKsful procedure of tb.e various programs presented 
vas the coriibijiation program. In V/erner^s earJier program the addition 
of the combination program had been found lo be helpful. It v;as an 
easier lasl; lo leach a child a b - d discrimination v;hen all of the 
trials in the day^s sesr.ion had only either b or d as the sample stimu- 
lus (even though the matches included the d or b disiractor) . Evidently, 
a consistent left '(or r^ghl) orientation of tlie sample stimulus across 
trials allows a preschool child to be more successful in matching. The 
number of possible (potential) correct stimuli on any one trial is 
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30 

ri'ducecl by hall' vrlieii cill the samplt's in a day'jj tJoyslon nni of llie Mnmo 
IcIdJ. U'hcM\ the! scuiip.lct; prrM.cMiL hr-th b's and d's somowhat: randomly acrorjs 
trial-f! (''.'.ilhiu a scjj.s ion) then there is the possibility that- oither tho b 
or the d on any one trJal v.'.i 11 by the S-h Ktiinulus. This appears to com- 
plicate the problem. The combination pro[;ram v/ap iflosignod to talte tv;o 
succe»ssi vely prcTicnted pro^'rauui and co:abinc thcm'>into a "simultaneous" 
(aerosr; trials but within sessions) format. 'The group that was able to 
make the hi^;liest i)er(:tMit of correct- rosponscG on the combination pro2;ram 
was t)ie c^'^^^n^ v;i(.h the most verlial label trniuinj^ dui*ing the story and 
tlic 1)- d i>ro-rar.;c; . 

The verbal .labels ( responjio.s ) th.'it the child was tau[j,ht to emit to 
tlie b and d stJiinili were taupjit to act later as difJcriminative stimuli 
when tlie eliild v;arji matching under the more difficult conditions of ran- 
domly presented b and d samples. The. cliild on any one trial had to look 
at the i'.ar.-.-ple , identify it, and then for a brief period of time "retain" 
in son-e manner the identity of the sample while looking for its match 
out of three po5-\siblo matches. It is during this short period of time 
that the cliild could have emitted the verbal label (identified In the 
sample) so tb.at this response produced a discriminative stimulus that re- 
sulted in identifying the correct match. VJhen the child did not have a 
verbal response (or some other resi>onsc) th?t could be later used as 
discriminative stimuli for the matching responses; or v:hen the verbal re- 
sponse was not accurate (on occasion calling 'b*, "Dub") then the per-- 
formance could decline v;ith mirror image ei-tors again -occurring. 
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, Tlici hcr*l c;v.ick:n(.i: Lc) supporL llui ir,Tiri ! r»c t;h:it the v(:i:!)a.l lnl.u»..l 

■». 

neted as a diMcrJiiiiuntivo nf lirAdu.s wIumi tlui child wct.s iii:)t;clriny int: t:ho cii\d 
of t;lic iraj.iifni; pr(.)[;,rani wnn rlic n^i:Ui probo c.irrlcd ouL al tho end of tihu 
. Siccoiul day of the. coiabi.naiioii iirc^[;rai!i, Th'^ only group Lhal had n consis- 
tently hli\h recall of Ihc labol \<ar, iho rc?f raln-vorbal Ixalion firoup since 
tho oLhor groups oporaLod at. chance! when rccallinji; Ihc names, or leys t:hnn 
'chfiticc (c'C'Uld not. recall iho naii;o) • Th:u> would .imply thai those latter 
grou['j: v/(!rc nut cm i.tt.in^;^, tl.ie naii'c-.i^ or v.*c?r(:; emlttinc thchi improporly on tire 

pO.^ittCJMt. 

It \,'as not i:o:i:Jll)le to record the vcrl»al labuliinf;; behavior during the 
posttojU: since tin: ev:p<.a- Jiacntcr told (and v/hcn necessary reminded) each 
subjecl. to m^t verbalize tho name-, but only to point. This; control v;as used 
GO that all four groupr; vou] d be posttested under the .sane requxreuients. 
l!owever> it \:ould r^coin t.hat rubvecal refjpondnij]; ':nn^y havc^ occurred for at : 
least tlie tv.'o required verbali^:ation groups. In the case of the refrain- 
verbali/cation group the recall of the verbal label could liave been more 
accurate .sliov;n by the name probe, and therefore discrimination behavior 
betv;een the b and d t:nded at a h±^^h level of correctness;* 

If thif? intci-pretation is correct, then it tends to support: 1) the 
use of a labeling response (during a pro^^ram tliat tenches a visual discri- 
mination) to serve as an added discriminative stimulus for a final visual 
diKcrJmlnatiion; and ?.) the necessity of a programmed pretraining procedure 
to teach the verbal lal^el prior to the program where the visual discrimina- 
tion is trained. 
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Table 1 
Four trecnfTiicnl: groups 



^ ^ }">r'hnv lor 
durinji b> d and 
combination 
pror;rnms --T^ 


]^}.:OUIRI£D VERBALIZATION 


NO-REQUIRED VERBALIZATION 


S*s behavior 
during r.trory 
_]:>ror.ra^:> 


Verbal - 
Refrain 
and 
Point 


No Response Specified 
During Story 
(sit) (sit) 


Point 


Average 
Age 


4-yrR 
5-nontl^s 


4-yrs 
2-mouthG 


^i-yrs 
'3~;iiontliR 


4-y rs 
2-montlis 


Male/Female 


2/3 
. N=5 


2/2 
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N=4 


2/3 

N=5 
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Pretest 
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53% 




53% 


54% 
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5 , ■ 

Tabic III 

Percent correct on rec£i].l of verbal Icibcl 
prior t:o first .(b or d) and 
second (d or b) programs 

.Prior to Prior to 

G_rojJ2^s first proru'an^ so c on d p r o \\ r nni 

Ref r.i in- 

required 80Z 80% 

verbali/:at:lon 



Point- . 

no-required 80% '80% 

V 0 r b ci 1 i t i o n 



Sit- 

requircd 63% 100% 

verbali.zafj on 



S3t- 

no-rcqiiired 50% 0% 

verba 1.1 nation 
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Tcible IV 

Sumnary tal^.le fo)* the analypi.? of varitii>c:c; based on a trend analysis of 
four [;,ruU]^.s (four condiLions of loi'irninc;) six probes (tests) 






sis of^ 


vni-i.-iiicc 


for a]l four ; 


proup.s 






Source 




df 


SS 




MS 


F 




Groups ('0 




3 


22, 


.30 


7.43 


1. 


,57 


Krror (A) 




14 


6G 


.15 


"4.73 






Prol?cs (6) 




5' 


87. 


.20 


17.44 


23. 


.57>'- 


Groups (/<) >: Probes 


(6) 


15 


27, 


,47 


1.83 


2. 


,47-'-- 


Krror (B) 




70 


51. 


,80 


.74 






Total 




107 


254. 


,92 






i 



*<.05 
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Table V 



Siiinmary table for Chc analysit; of wiriance based on n trend analysis of 
two troijps (two coP'r'iti.cps of learnjnn) >: six probes (teste) 

A n rtly. sl;'> G f yji r Inrce f or re f rn 5 . n ■ c I * y*^^*^^ t-no v:?.rb . 



Source 


df 






MS 


F 




Groups (2) 


1 


21, 


.68 


21 . 68 


3 


.18 


Krror (A) 


7 


hi . 


.67 


,6.81 






I'robcs (6) 


5 




.59 


8.12 


35, 


.32* 


Croups (2) X Prober. (6) 


5 


36. 


,88 


7.38 


33, 


.92''= 


Krror (li) 


33 




.68 


.53 






To La J 


33 


3C5. 


,50 









Annly fri .s of v;ir innce _for^ r c f rrA x\-t. eg. v e r 1^ P o ^ '-tip •/ c h . 



Source 


df 


SS 




MS 




r 




Croups (2) 


1 


k. 


,26 


A 


.26 




,56 


Krror (A) 


8 


60. 


,33 


7 


.54 






TrohcH (6) 


5 


88. 


,93 


17 


.79 


22. 


,79'"' 


Croup.': (2) :■: Pro be; (6) 


5 


10. 


,5/i 


2 


.11 


2. 


,71-'- 


Krror ();) 


/iO 


30. 


,83 




.77 






Total 


59 


3 1'/i . 


93 











Ana \.y i\ i j2. of va r in ncic f or r e f r a J.n -r e g . v e.r h\ 5> j t - r eg . ver_b_. 



Source df SS MS K 



Grou]^.'; (2) 
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7, 


.17 


7'. 17 


.99 


Krror (A) 




7 


50, 


.55 


7.22 




Probes (6) 




5 ^ 


69, 


.02 


13.80 • 


''13.13--'- 


(Groups (2) : 


■; Probes (6) 


5 


17. 


,91 


3.58 


11.18-'= 


Krror (B) 




35 
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,03 
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155. 
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Tabic V C<nit:iijuecl 



Annlv.sifJ of 


variance 


for 


]->oint.-no verb; 


slt-req 


. verb. 








Sourc e 




dC 


SS 


MS 




F 




Groups (2) 




1 


.53 


. .53 






.03 


Error (A) 




7 


18. /i8 


2 . 6''.. 








Probes (6) 




5 


33 . 55 


'6.84 




6 


.84=^ 


Groijj)5i (2) X Probes 


(f>) 


5 


1.65 ■ 


. 33 






. 33 


Lrror 




35 


35.12 


1 . 00 








Total 




53 


-■ • 89.33 










Analy.*-: i.i: of 


V n V \ a n c e f o r j') o i n t: - ri n v e r h ; 


f^i L-no 


vcrl) . 






















Source 




df 


SS 


MS 




F 




Groups (2) 




1 


7.3A 


7.34 




3 


.29 


Error (A) 




7 


15.60 


2.23 








Probes (6) 




5 


13.87 






2 


.39 


Groups (2) X Probes 


(6), 


5" 


13.87 


2.11 




2, 


.39 


Error (1>) 




35 


^i0.75 


1.16 








Total 




53 


91,^3 










Analv5^iK of 


variance for 


sic-rnq. verb; 


.si t-no 


verb . 








Source 




df 


SS 


MS 




F 




Group,s (2) 






3. -53 


3.53 




3. 


.63 


Error (A) 




6 


5.80 . 


. .97 








Probes (6) 




3 


6.87 ' 


1.37 






33 


Groups (2) X Probes 


(6) 


5 


8.33 


1.57 






40 


Error (B) 




30 


20.95 


.70 








Total 




/♦7 


/.5.48 











*<.05 



46 



PERCEiviT CORRECT ON ALL TESTS 
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PERCENT CORRECT ON RECALL OF VERBAL LABEL 
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liONGHY-BKL: Ai:i) DUU STORY 



1* This is Mother Duh. (ExperimenLer points to Mother Duh) . Point to 
Mother Dull. Baby Duh is in her pouch. CExperimenucr. poinus to Baby Dah) . 
Point to i5aby Duh. }Jaby Duh likcy to ride in his mother pouchy and 
holds on tiglitly. "Uh huh," says Mother Duh v;hen they are both having fun. 

2. Mother Duh hops and hops. She hops over a puddle and a wagon. Point 
Lo Mother Duh. EabyrDuh likes that very much. They are both having fun, 
so, "Uh huh," says Mother Duh. 

3. SometiK'.es Mother Duh even juraps over tilings like trees a^id houses. 
Point . to I-Iother Duh. Baby Duh goes sailing along with her. They both 
think this is great fun, so, "Uh huh," says Mother Duh. 

A. Mother Duh and Baby Duh have many friends. One Friend they like to 
visit is Bonghy-Bee. (E>:pcrimenter points to Bonghy-Bee) . Point to 
Bonghy~Bee. Bonghy-Bee has a magic bong stick that Baby Duh likes. 
(Experimenter points to the bong stick). Point to the magic bong stick. 
It makes things go away and come back again. When the bong stick works, 
Eonghy-Bee gets excited and, "Wee, gee," says Bonghy-Bee. 

5. Bonghy-Bee enjoys going to the park with Mother Duh and Baby Duh on 
warm days. Point to Mother Duh. Point to Bonghy-Bee. On their way .to 
the park. Baby Duh likes to play games. Mother Duh likes the games, too, 
so, "Uh huh," says Mother Duh. (2 pages) 
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6. V/hcn they ^cit to the park, Bonghy~Roc rjho'./s how he can make thin^^pj go 
away v.'lth his bong stick. Point to Donghy-Bce. Point to Mother Duh. 
Quick as a v;ink the bush they had been standing by was gone. Bonghy^Dne 
got all excited and, "Wee, gee," says Ilonghy-Bee. pages) 

7. (KighL picture) Daby Duh thought Bongkiy-Dea ' s magic stick was great 
when Mother Duh*s hat was gone. POOF! Point to Mother Duh. Mother Duh 
wondered where her hat was and said the game wan fun, so, "Uh huh," says 
Mother Duh. 

8. (Left picture) Baby Duh \7anted to knov/ what other magic th.ings Bonghy- 
Bee could do and Poof! Bonghy-Bec's stomach was gone. Point to Bonghy~Bee 
His round tummy was gone as gone- can be. Bonghy-Bee liked that and, "Wee, 
gee," says Bonghy-Bee. 

9. Baby Duh was so happy that he began jumping up and down in his mother's 
pouch. When he stopped jumping, he found that his mother's ears were gone! 
Point to Mother Duh. Baby Duh and Mother Duh thought the game was great, 
so, "Uh huh," says Mother Duh. 

10. Bonghy-Bee thought it was a good game making things go away. Point 
to Bonghy-Bee. Suddenly his own hands were gone! This was great, and 
"Wee, gee," says Bonghy-Bee. (End of session one) 

a. Remember Bonghy~Bee and the magic bong stick? Point to Bonghy-Bee. 
Now point to Mother Duh. Do you remember the game they were playing-? 
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11. (Ki^lil. picture) Baby Duli v^anLcJ Mother Duh'y nose Lo be £;one. JubL 
ns LOon ai> he hnd asked ]ionghy--iico , MoLhcir Duh's nose v.vii^ gonn. Point: to 
Mother Duh, At first, Mother Duh was surprised at what the magic bone 
stick had done, but Llicn .said it was fun, so, "Uh huh,'* says Mother Duh. 

12. (Left picture) Then Bonghy-Bce said he would make one of his own 
leas leave with the inajUc bong stick and he did. Point to Bonghy-Bee. 
It was gone before he knew it and^ "Wee, gee," says Bonghy-Bee. 

13. Baby Duh said that he would like it very much if Mother Duh didn't 
hpvo any eyes. >^onghy-Bee thought a i?.inute, then POOF! Mother Duh's 
eyes were gone. Point to Mother , Duh. Mother Duh thought the game was 
a good one, so, "Uh huh," says Mother Duh.. 

14. Before Baby Duh could say anything, the magic bong stick started 
working and Bonghy-Bee's other leg iv'as gone. Point to Bonghy-Bee. This 
was exciting for Bonghy-B-G, and, "Wee, gee," says Bonghy-Bee, 

13. Baby Duh was having the time of his life. He had Bonghy-Bee use 
his magic bong stick to make the rest of Mother Duh's head go away. Point 
to Mother Duh. Mother Duh look-d very different without a head but she , 
was enjoying the game, so "UV nuh," says Mother Duh. 

16. One of Bonghy-Ree's arms was there one minute and was gone the next. 
Point to Bonghy-Bee. The bong stick worked its magic very fast. Bonghy- 
Bee was excited, and, "Wee, gee," says Bonghy-Bee. 
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17. (Kiglit picttira) Baby Duh wawted one of Mother Duh's arms and hand l:o 
go away, too, and lhc;y did with the help of the. hone stick. Point to 
Mother Duh. V/hat a surprise to Mother Duh but the came was fun, so, "Uh 
huh," says Mother Duh. 

18. (Left picture) The bon^ stick started working again before Baby Duh 
could say anything. Mother Duh's purse was the next thing to leave. Point 
to Mother Duh. Mother Duh thought it was great, so, "Uh huh," says Mother 
Duh. 

19. Baby Duh wanted to knov/ if Eongliy-Bee could use his magic bong stick 
to make his own feet leave and POOF! Bonghy-Bee had no feet but the flower 
on' the toes stayed on the ground. Point to Bonghy-Bee. Bonghy-Bee was 
excited to see that happen, and, "Wee, gee," says Bonghy-Bee. 

20. Even though it was great fun to hop. Baby Duh was having such a good 
time v/atching things go away that he didn't want Mother Duh to hop anymore. 
All jf a sudden. Mother Duh's long tail she used to hop with was gone. 
Point to Mother Duh. WOW! This game is fun! Both Mother Duh and Baby Duh 
agree, so, "Uh huh," says Mother Duh. (Hnd of session txv'o) 

b. Do you remember Mother Duh and Baby Duh? Point to Mother Duh and 
Baby Duh. Do you remember Bonghy-Bee and the magic bong stick? Point to 
Bonghy-Bee. Do rctmember the game they were playing? Let's see what 
happens today. 
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21. (I'ii^liL pJcUirci) V.'!:nL would noxt? Taby Huh thoM[;liL a mintjte and 
Kciid b.ia ;:ior.!;('r ' .s othctr arm avul hritid. The \\\a^,ic bona •'3t:ick went POOF! 
and they uoce ['.rnL-. Point to Mother Duh. This wns a^^^'^'^^i -'O, "Uh liuh," 
pfjyG MuchoL' Dun. 

22. (Left pict\iro) Uo\: liaby Duh decided he wantt^d Bonghy-Bee ^ s collar 
to ['.o av:ay. The inag.ic bon£; ytick nuidc the collar go away lil:e magic! 
Point to Bonghy-rjee. The gai.iG was fio exciting for Bonghy-Bee, and, "V/ce, 
gee," says Jjong't;y*-Beo . 

23. (Left picturfj) The next thing I'?other Duh loyt was her chest e Point 
to Mother Duh. The bong stick has made many things go away. Baby Duh 
and Mother Duh think the ganie is fun, iio, "Uh huh," says Mother Duh. 

< 2A. (Right picture) Mother Duh couldn't walk without any feet hut Baby 
Duh wanted the.-n to be gone, and tliey were with the help of the magd.c boiig 
stick. Point to Mother Duh. It was a different feeling not having any 
feet but it was fun, so, "Uh huh," says Mother Duh. \ 

25. Next J Bonghy~Bee lost his other arm with the magic of the bong stick. 
Point to Bonghy-Bee. It would be hard to use his bong stick without. his 
arm but Bonghy-Bee was excited, and, "Wee, gee," says Bonghy-Bee, 

26. Baby Duh decided Mother Doh's legs should be gone. The magic bong 
stick started v:orking again and made chera leave. Point to Mother Duh. Th: 
game is great think both Mother Dull and Baby Duh, so, "Uh huh," says Mother 
Duh. 
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27. The ina^;ic bong .stick was stlil at work and made Kon^^liy-lice *s hat leave. 
POOF! It was f^onc! Toint to Buni,»hy-Bcc, ]ionf»hy-Iiee wns excited about that 
and, 'Vee, gee," says lionf,hy-lieo . 

28. Baby Duh tliou^ht it would be fun if his own ears were fjone and in no 
time at all, they were with the help of the maf;ic bong stick. Point to 
Baby Duh. WOW! Baby Duh said he really tikcd this game, so, "Uh huh," 
says Motlicr Dull. 

29. The next things to go were Bonghy-Bec's eyes and nose, Bonghy-Bee 
liked the magic of the bong stick. Point to Bonghy-Bce. This was exciting 
for Bonghy-Bee, and, "Wee, gee," says Bonghy-Bce. 

30. POOF! went the bong stick and Baby Duh's hands were gone. Point to 
Baby Duh. At first Baby Duh was surprised but both Mother Duh and Baby 
Duh said the game is fun, so, "Uh huh," says Mother Duh. (End of session, 
three) 

c. Do you remember Bonghy-Bee and the magic bong stick? Point to Bonghy- 
Bee. Do you remember Mother Duh and Baby Duh? Point to Mother Duh and 
Baby Duh. Let's see what they do today. ^ 

31. Quick as one, two, three, the pointed ears on Bonghy-Bee were gone. 
Point to Bonghy-Bee. The game with the magic bong stick was still exciting 
for Bonghy-Bee, and, "Wee, gee," says Bonghy-Bee. 

32. The eyes and mouth on Baby Duh once were there but now they are gone. 
The bong stick made them leave, quick as a-wink. Point to Baby Duh. IThat 
fun this magic game is, so, "Uh huh," says Mother Duh.' 
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33. Tjo. hvv.v, cli.ik workc::! u<r,:t on I5.'Mi;;i:v-Bee liAir and month. SudclcMvly 
they vcrc! f.onci! Point: to Jionf;.liy'-LWjc. V/luin Donj^hy-hec notJcod tboy v/oro 
goHLs he bi'CJua cxcit:od, and, "Woc;, k^^*-*" ^^^^^ys Bon^'.hyi^CQ . 

34. The next- Co );o v;il:h Lhe iicip of tlie Tuafiic bor;; sticli wa.s Ilaby Duh. 
Point: tc Mothcir Ihih. He was gone as [^Oiie can be. Oh, what: fun this game 
is, so, "Uh huh," sayc Mot:lier DuIk 

33. (Riclit: rict'uJ^c) And Bonchy-Bco, why his wliolo. head is gone nov?. Point 
to Bonghy-nec. The c^nie is really exciulng for Iionf;hy-Bee , and, "Wee, gee,' 
says Bongliy-I'r-e . 

36. (Left picture) With Baby Duh gone, there was no need for Mother DahVs 
pouch so the bong titick made it go av^ay, too. Point to Hotlier Duh. Both 
Baby I^uh and Mother Duh agreed that the ga.ne is fun, so, "Ul\ huh," says 
Mother Duh. 

37. Bonghy-Bee decided to play another game. Ue made the bong stick work 
more magic and riade Mother Dull and Baby Duh coiiie back to how they were before 
Point to Mother Duh and Baby Duh. This was really a surprise to them, so, 
"Uh huh," says. Mother Duh. 

38. Bonghy-Bee decided to co:ne back with his friends and quick as a wink, 
there he v;as. Point to Bonghiy-^Bce . Bonghy-Bee thought the bong stick 
could do some very exciting things, and, "Wee, gee," says Bonghy-Bee. 
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39. (Ri[;hf picLure) Noxl Mollier Duh imd h'nby Duh \}crv c\\auzi\d :q;aj.n vd.Lh 
the help of the bonj; stick. Point to Mother Duh, ThIiJ ^amc Is |;ront fun, 
so, "Uh huh," sayfj Mother Duh. 

AO, (Left picture) }:'on[^hy- IJee now inndc hIiTir.clf leave, too. Point to 
Bonghy-Dce. He was excited bac:iu.se of all the things; the bong atick 
could do, and the p,anie was such fun, and, *'V/ec, gee," cays Bonghv-Bee. 
(End of sefision four) 

d. Do you rec^emhcr Mother Duh and Baby Duh? Point to Mother Duh, Do 
you veineniber Bonghy-]>eo and th.c ir.agic bong stick? Point to Bonghy-Beo. 
Let's see v;hat they are going to do today? 

Al. Bonghy-Bec, Mother Duh and Baby Duh v;anted the magic bong stick to do 
different magic things today. Bonghy-Bee s ^id he would use the bong stick 
to make them all get smaller and POO?"! They were all a little bin smaller 
Point to (cue Duh) and say Duh. Point to (cue Bonghy-Bee) and say Bonghy- 
Bee. 

42. Baby Duh said he liked being smaller but he really wanted to be even 
smaller so that when he played hide and seek, no one would be able to find 
him. Point to (cue Duh) and say Duh. Point to (cue Bonghy-Bee) and say 
Bonghy-Bec. 

43, Bonghy-Bee thought that being even smaller would be fun, so the magic 
bong stick went POOF again and made them all smaller again. Point to (cue 
Bonghy-Bee) and say . Point to (cue Duh) and say . 
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^1^1. MoLh'T ])\ih til'O 1 i 1 bcii'v; i;rn.-jjl. She iiai.i ahn had wot been .small 

for i\ Jon^; t. ,i.i:u.'. V.'iKMi 'aVo smajl, you can liiclc, bel>lnd clialrs, and bur.hcs 

and oil k.ir^<^ ci* ^n?ni/^. Voiwt to (cue Duh) aiui r>p,y . Paint to 

(cue Ho;i;;,!iy-I'eo) niKi sny • 

45. l'.on[;liy"Bt;c .^;a.id that ;lC ho was very small, he v;oulu have hir, bong sJtick 
do m.-i^jLc and he \sould be so cmnll that jo one would know he was the one 

doing thf r.iai^,ic . J'oint to (cue Bon[.;hy-Bee) and «ay . Point to 

and .say (cue Uuh) ^* 

liaby huh wnt; .small before tiiey sLarLod to play the ^',a»viv; bo he kncv; Vie 
could do v.uii)y thin^^s boini; f:r:all. Just think of all the thinp^s they could 
do* if the bong cl.ick n;ade then all even smaller! Point to and say (cue 
Duh) . Point to and isay (cue honstr/-}>eo) . 

/♦7. L:aby Duh said he liked being smaller because he could hide behind 
grass and flover?;. Bon[;hy-Bec said that sounded like fun so ho had the 
magic bong stick make them aJ 1 smaller. Point to and say (cue Duh) 
. Point to and say (cue Bonghy-Bec) . 



A8, They all decided tliey wanted to be a little bit smaller because 
sinall is a nice thing to be. They knew they could always have the magic 
bong stick make them big again if they wanted. Point to and say (cue 
Bonghy-Bee) . Point to and say (cue Duh) 



/<9. JioniUiy-lioc was havJiit; n gre:il. tiimc mnkinj^, tlicin all «!na]l vlxh the 
nic'igic bon;; at. ic!;. He r.ald lie liked bcJn^; f;ianll 5»o mucli thnl lie would make 

them small iij»ain. Point to and .say (cue Don^^.liy-Hee) . Point 

to and say (cue Dull) • 

50, They dc . idcd they did want lo bo bi[; again bec'./iui;c tliey were tired and 
It was [;etting late. They knew tliuy could play the [;ame a[;ain some other 
day 5;o the bong stick made them big again and home they went. Point to and 

say (cue Eou[;l,y~i;ee) Point to and say (cue Duh) • 

( End o f r> c s s i on f i v c ) 
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v;ho had ;iero errors. The range average means for the three groups are 
given in the bo:-:os. The bars are of individual percentages. 

13: Individual percent correct of complex relational concepts across two 
pretests (four sequences) by groups, subjects-to-be-programmed^ and subjects 
v;ho learned through pretests. 

14: Percent correct on first two pretests and additional pretests for 
individual subjects on complex relational concepts. 
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J-'ifci, 13: .rcrccnt: cori'c-ct: on acldittionnl coiiiplc:: prc-to.s*lG for f>ubjoci:f; vho 
IcariKtci on first t\/o preCcsLs. 

ri[;. 16: Percent correct across ' v7o prci'csts*"(f our sequences) for subjcct.s- 
to-be-prc;i.',ra:iiiiied rrinl suljjecLs \;lio le^u'iicd during lu'etes ts • 

Fi.j^. 17: Coiapnri*;on of ])i'Ov';r.'{imned and nonpro^^rammcd (control) sequences for 
Subject 0 (Top iiiglit liack) progrcin. 

Fij;, 18: "Percent correct on i)-i:e-po£tte.st and intervening programs (Rif^ht 
l-ront/Cenlor F?;ont, Top l^iglit ]iack/Top Left Hack) for Subject J. 

Fig, 19: Coiiij^arir.on of prograiiuncd (Left Side/llight Side - Left Front/lUglit 
Front) and nonprogrMir.iued (control ) sequences for Subject L. 

Fig. 20: Coiiiparit^on of prop.ranuned (Left Side/lliglit Side) and nonprogranraied 
(control ) sequences for Subject I. 

Figr 21: Coip.parison of programmed (Top Left/Top Right) and nonprograiiimed 
(control) sequences for Subject H. 

Fig. 22: Comparison of programmed (Left Side/Right Side) and nonprograiiimed 
(control) sequences for Subject A. 

Fig. 23: Percent correct on pre-posttcst and intervening program (Left Front/ 
Right FVont) for Sul^ject M. 

Fig. 2.'i: Percent of increajie or decrease of correct resiJonses from pretests 

to posttcsts on nouprograniined stimuli for experimental and control subjects. 

Fig. 25: Total experiinental history (nine complex relational positions across 
four tests v;ith intervening programs) for Subject J. 
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1NT1:0DIICTJ0N 

One of tb.c. basic prf-acadcmic skills thcnl;_niost prosaiool cliildren acquire 
before sL<.rf.i rsg Llieir formal education is appropriate responding Lo di.recLions 
that contain spatial rclrntional concepts. One source of normative data 
(Castner, IQ-'jO) collccLcd on tv/o through four year olds indicated that instruc- 
tions ^4^ich contained "on," "in," "behind" or "in back of," "in front of," 
"under" and "beside" resulted in Increasingly successful responding across 
this age range. Tvo year olds did not exhibit behavior that would indicate 
a consistent discrimination betv7cen these words. By four years of age most 
of the children are successful with at least four of these relational concepts. 

'Most of the developmental literature further suggests, that these simple 
relational concepts (in, on, front, etc."* are acquired earlier than those 
that contain some aspect of a left-right orientation. For example, "side" or 
"beside" V70uld be a functional term for a three or four year old preschool 
child, while "left side" may not necessarily be responded to in a consistent 
manner. For example, Boone (1965), noted a time differential between the 
acquisition of such concepts as "front" or "behind" and those with a left-right 
or i.cntat ion . 

The importance of a child acquiring these concepts has been consistently 
pointed out by those concerned with planning preschool curriculums. Teachers 
note that much of the child's future learning is based on, and in fact uses the 
acquisition of relational concepts in order for otlier responses and skills to 
be learned. 

F.ngle CigCA) noted that a relational concept was one that di^ not shape 
a fixed characteristic (as do other concepts^ but instead shares fixed 
relationships. For example "hardness" is a fixed physical characteristic 
wliich is found in many materials. >!ov7Cver, to "explain," "in front of," 
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vcqulros a cotnnion ijjj.ui.cil or J.lmiLci i: ion of owv. objocl. t.o nnoLhcT. 

Hi. J.j;.n-(1 (lOu'O clcscrihccl oanccpLs in tcrrnis of cor.uiRin or sjhnrfci qu:i3 1 L ics 
in otherwise diverse- objects, situations or civciitt;. IKsing both K?v.;lc:'s and 
Hi.lgard' r» clef i ni to'.ons of I at loiial" and "foncopt," i,t i.s possible to dofino 
simple, r-ind copipJc^x, relational abstraction!; ns used in tiic present study, 
llov/ever, for the purposes of tin's research, the tcrni ''abs t.rac t ion" instead of 
"concept" wil) be uscci since this places the "common ch::rac ter is t ics" in th.e 
onviron:iienf ratlier than in the "r.nnd" of the subject. 

Rolr-ri iou.il abstractions refer to specific stimuli (for cxaiiiple, "loft side" 
and "top left bacli") th.it are acquired because of a common spatial orientation 
of the ]».:tr t icul ar positions to an object (a h.ouse). Simple abstractions refer- 
to a single orientation of one object to r.mothcr; while a complex abstraction 
refers to ty/v;> or more common spatial orientations. 

The purpose of the present study v;as tv;ofold. The first was to collect 
descriptive test data on a group of preschool children with' respect to their 
consistency in follov:ing directions which- used both simple and complex 
relational terms. The second purpose was to devise procedures that would 
help preschool children acquire th.ese behaviors if they were not observed. 
Since the past normative and descriptive data indicated that follovrin^; direc- 
tions V/hich ■> de complex relational abstractions arc usually not a part of 
the preschoo: child's repertoire then errorless (programming) procedures 
were usod in the training programs. Terrace (1963a, 1963b) described several 
procedures that resulted in an infahunian organism's rapid and near errorless 
acquisition of a visual discrimination. These procedures v.'hicfi iijcluded the 
fading of lights were incorporated in the present study in an attempt to see 
if preschool children could learn the more difficult relational discrimina- 
tions . 
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METJIOI) 

SubjccLs 

*** 

Ti)o KubjcCLs v;cro 19 chllclrca from the Edna A. Hill Child Development: 
Prcsciiool I-iibornLor ics nt the University of Knnsas. Their ages ranged from 
three years one monlli t:o four years eight months V7ith a mean age of three years 
ten and c^ne half nionLlis. The children were not selected for the. study on any 
basis other than the fact that they were available as experimental subjects 
at the ti:r-e the study was to be run. Hov/cver, the 19 children were a fairly 
he terc)?;enco\j.s group (drav/n from four preschool classes) with respect to 
socioecononVic . inconic, race, and skills demonstrated in each of their classes. 
A p pa r a t u r > c ni d T.x p e r i v.\ o n t a 1 Setting 

The experimental room was a v;ell lighted and ventilated sound resistant 
room measuring six feet wide and fifteen feet long. ' The subject stood on a 
"happy face" bo^ird that had been placed'^'on the floor prior to the session, 
approximately seven feet from the response apparatus, the "magic house." Hacli 
response key of the "magic house" was a tv7o by three inch plastic rectangle. 
An orange foam rubber pad, circular in shape, was the response target. This 
target area was mounted in the middle of the response key. Behind tlie key 
was a microsv7itch (nor;nally open), that, when activated by the subject pressing 
the pad on tlie response key, resulted in a signal to the electromechanical 
relay rack. 

The subject vjas given a "magic V7and" to push tlie response keys. The 
"magic wand" v/as constructed from an eleven inch long, three-eighths dowel 
rod glued into a ruhber ball. The "magic house" was twelve inche.^ wide, 
twelve inches deep and fifteen inches tall. There were three response areas 
in the "front"; rigiit front, center front, and left front. In addition there 
was one response area "under" the house; one in back for both "back" and 
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".behilur*; one (en each '•jjiik'*'; vi[\\iL side- Ci\iC lof,l sid,-.; cinil four on "toi/' for 
top rij^lit: front:, Lop rif;(it: back, top left: front, nnd f.oj) Ici'l back, (Also 
*'t:op rij'.tif," "top lo.fl"). This allov.'cd se^'-wtccn responses of Vciry i.ng dif- 
ficulty (diia t:o coni!)inaLions of rclntionnl tonus) Lo bo tested. 

Kncb posit.iop. v;cis wired in conjunction vjith nn c'lectrc>incclianlcal relay 
rack v/hich recorded: correct res-ponses; jncL';rrcct responses; and total correct 
responses (by ir.Gcmfi of four banks of dijjj'^^^- counters and a t:v:cnty p.-n Kster- 
line An[;ns event rec^.-rdc-r ) . The event recorder wiis ' i)rof;ranMiied to record intra- 
trial responses as well as correct and incorrect response positions. V.hcn the 
subject pressed the correct kcty a chime soi^nded from v;ithin the house and a 
marble v;as simultaneously delivered from a marble disi)cnser reseiiibl ing a clown. 
The clov/n had a nose (red bulb) that illuminated v;ith each correct response. 
This marble dispeiiser was located approximately two feet from tlic ''magic house." 
Rcinf arcer;icnt could be either automatic or nianually controlled for correct 
response. 

Programming cues attached to the house v;erc red lights located one -ha If 
inch above each response target area. Any one or all of rhe lights could be 
dimmed from full brightness on a 'continuous scale to fully out. They could 
be flashed at various rates or held at a constant intensity, or turned on or 
off for any sequence. Another programming cue was a huzzei: 'that could be 
turned up or dovm on a continuous scale of volunie and could be physically 
placed by hooks at any of the response target areas. The onset and offset of 
the bu^^:er was controlled by the experimenter. 
Procedin:es 

The experimenter acquainted each subject v;ith the experimental room and 
the reinforcement delivery system. The subject was then shown a box with a 
number of toys and told to choose one chat lie liked. The toy v:as then placed . 
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over fi iK.lc that v.rn tynrliod by an ornn-c circle;. Tlic. subjoct vns iheii Lold 
if ho goL ououpji inarl^lcs t.o fill iill ol* the Ikoles up icrand in ihc. orange 
circle he v:ould i^ol the toy.^ 
Machine Trriinin ?; n,^^ 

A .n}achine Lralni.nc; i;oss">.on was fiDrsL given to each subject. A red light 
V7as on over the correct response ^Carget area and the subject -was instructed to 
"find th('. rod light that is on and push Ihc ball undnr it." The machine train- 
ing session consisted of nine responses designed to acquaint the subject with 
each response area. At no time was the nair.e of a position used during this 
init ia 1 machine t ra ining sess ion . 

EXPElMi-n-KT I 

Assessment and Training of Simple Relational Abstractions 

Pretes t 

Following macliine training subjects v:ere then given four days of simple 
pretests. Each pretest day tested six positions (front, under, behind, top, 
side, and back). This simple pretest was made up of twelve trials v/hich meant 
that each position was tested twice.- All six positions occurred during the 
first half of the pretest and were followed by a different sequence of the 
same six positions in the second half. A copy of tlie simple pretest data 
sheet Is found in the Appendix. 

l*he four days of pretests v:ere given without the use of any light or 
buzzor to cue the position. However, if the subject was correct, the house 
v/ould ring its chime and the clov;n*s nose v;ould light up as a marble was de- 
livered. The subject v/as instructed that the experimenter would tiell him 
v;here to put the "magic wand" and that if he was correct the house would ring 
its bell and tlie clown would give him a marble. ..The subject's data was then 
analyzed after these four simple pretests to see if and what type of training 
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pi'oQmnx w;'.:; needed. Sorno subjects init:J.ally served ns e.onLroJs to i nves t: i^'.r; : e 
rlie oflccLs of. Lri.al. <iik1 error learning; in cornpar i.son Lx^ pro^;,ramiii Ln[^, 

There were Lliree c'.enoral types of trnini.ne; procedures used. 1 . ) In the 
no fnding l-po.si.l:ioiis-cued group, the subjects had a red light over each posi- 
tion to Achich they vjore instructed to respond. The light \n\s on regnrdJess of 
v;h ether the child had errors or not to that position during the pretests • The 
second day of the training- program vas the same as the first except no light s 
v/ere on during the sequence. Therefore no fading of lights v/as involved with 
this procedure. 2.) In the group that had fading with one-or-two-positions-cuod , 
the .subjects had a red light or buzzer over a position which the i^rctests had 
indicated v/as not successfully respo.nded to. Other positions used in tiie traiii- 
ing sequence v/ere usually those to which the subject had successfully responded 
to on the pretests. The programmed cue for any response t':at v/as being trained 
was first presented verbally and in unison with the red light and/or bui-.zei*. 
These light or buzx.er cues were located above the positions being trained and 
were faded out in intensity an>'\7herc from one to seven steps. Since there were 
lights located next to each response key there was no need to remove the light 
apparatus (e.g., socket, etc.) siter they were faded to total dari;ness. When 
the buzzer v;as used it had to be physically removed when its sound was com- 
j> 1 etc ly faded out, since it was added to only one location, for programsting 

purposes. Units of fading (of lights and buzzer) were accomplished by the use 

2 

of a calibrated potentiometer, 3.) The third group was trained primarily 
by verbal instructions. This group v;as made up of children v;ho had only 
one consistent positional error. Then when they made an error to this position 
the experimenter told the child the correct position, pointed to 'it:, and had 
the child respond. Thereafter no further instructions were given and the 
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c:ffccl:s v/crt' Llicn luenjuired by c\i\i a from subsoquont: trials and session.*;. 

Individual procedures for eacli subjocL v/iuhin qo.c]C of. these three 
training conditions will be noted during the analysis of their data. 
Desig n 

The descriptive datum on the 19 subjects was collected by repeated pre- 
tests (A) and analyi'.ed for evidence of acquisition curves. Additional pretest 
v/ere also given to subjects to sec if learning would occur v/ith extended trial 
and error experience. As a result of the pretest data subjects were grouped 
into those that: 1. had ^ero errors across all pretests; 2. met a criterion 
of 1007^ correct on two successive pretests after initial errors; and 3. those 
that should have training since acquisition to a 1007, criterion on all posi- 
tions did not seem to be possible with repeated pretests. 

The training design was then a simple pretest-training-post test design. 
IIov:ever, additional controls were possible by replicating the training pro- 
cedures across subjects and through the use of controT subjects . The control 
subjects received the same sequence, number of trials, sessions, and instruc- 
tions, but they did not receive the light and/or buzzer cues or the fading 
procedures. Table I summarizes the experimental history for each subject 

Insert Table I About Here ' . 

that did not meet criterion behavior on the simple relational pretests. 

RESULTS 

DescrlpLivo Data on Simple Relat ional Abstrac t Ions 

\ 

Of the 19 subjects, ident if ied . by letters from A through S (Fig. 1), 

Insert Kig. 1 About He^re 
almost half (47%) were placed in the to-be-programmed gro*up since they did not 
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met»t: ihc crilcrion of J C'07. correct; rosponsos on Lhcij: lii.sL' l:v;o prcicsfs. This 
j'.rc^^M' (Subjects A rhrou<',h 1) hncJ on .'ivciro^e of 79X corrc^cl: rcsponso.s to i:he 
simple rcl.'i I i or-ja 1 po.siLions of front, unclear, ])cl!iiul, Lop, side, and bnci;, while 
their individiKiI porcc»n:.nf;c.s vani\cd from 67 to 90;^. 

Subjcc.t.s J t:hroij^:;h :i (217o of Lhc l;ol;al group) met: liic criterion of 1007u 
correct rcspoiulin^; on Lv;o successive preiosls, Hiosc .subjectzs had errors 
init ially on iheir f.cjMis ciul t:hcrefore averaged 93"-^ on all four t:ests v;i f.h 
individual porcenfa^,cs ranging froni 80 t;o Only one subject: in Llie i:o-bc- 

programmed group (II) rv^idc a higher pcrcenlage corrr-* t: across the four pret:esl:s 
t:hap. Subject J in the *'3earr.ed" group v/nosc percentage v;as 88. Otherwise the 
two groups did not overlap. 

Six subjects; (K thorough S) made no errors during the pretests and made up 
• 32'>o of the total group. As a result, approxima L e ly ha If (537L) of the 19 chil- 
dren in this r.tudy either consistently resi>ondcd corre^ctly or with little in- 
struction (trial and error responding v/ith feedbnclc for correctness on]y) acquired 
those simple relritional. abstractions. 

Fig, 2 shovrs the percent correct of each of the four pretests for indlvi- 

Insert Fig: 2 About Here 

dual subjects in the to-be-programnied and learned groups. The nine subjects 
who v/cre trained by some proceduTG (top thr j rov;s of graphs) did not tend to 
shov.' the same *'st air-st cp" increase across pretest;:^ as did the subjects who 
learned. 

AddilionaJ pretests (Fig. 3) were given to Subjects B, C, ancj F from 

Insert Fig. 3 About Here 
the to-be-programmed group and J and M from the learned group.' There was a 
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sllL'hi." iricrcniic In I'hc pcrC'^-'nl correct on Lho addi.lional prelcsl;?; for Subjc-cLr; 
B, C, and I- (v/ho lu:d 7, 12, 2 add i L i onn l^L es L: s respectively). 

Fig. A sliows Lhc data on Lwo of these subjects (B and^C) lor the beliind 

Insert Fig. A A'out Here 

position (dotted line) and all positions (solid line).. The data indi- 

cate that these ivo subjects started to respond correctly (and consistently) 
to "oliu--' positions during lhc first four pretests, but never "learned" behind 
in eitht-r 11 or 16 sessions. In contrast Subjects J and M (Fig. 3), with one 
additional pretest, met tl«e criterion of tv/o successive pretests of 100% 
correct re.spondint^ c)n each vith only one additional pretest. 

In Fig. 5 the. data are plotted by each simple relational position on 

Insert Fig. 5 About Here 

each of the four pretests. The dotted lines represent the data for the sub- 
jects wlio learned aivJ the solid curve the subjects to-be-programmed. By com- 
paring the curves of these tv;o groups, it appeared that the positions "under" 
and "top" were responded to equally successfully. Both groups were above 907o 
oi^> 'al'l-'-tc.sts.. The other four positions (front, behind, side and back) were 
consistently responded to with a .higher percent of correct responses by the 
subjects \Jho learned. The one position v/ith the greatest discrepancy between 
the two -groups was "behind." It is doubtful that the to-bc-programr.ied subjects 
did not tend to respond to this area because it was not in viev; when the sub- 
jects received their directions facing the front of the house. This could be 
concluded since the "back" position (same location as behind) v/as responded to 
with the most correct responses of these other four positions by the to-be- 
programmed group. 
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Mm n(j r J uv.-nt rO 'i'rninhir. VwM r. on S i tj p I c \\q 1 t: i I' ni 1 Ab a i; r tm t )' on? ; 

Tv;o r.uljjccts (A <ind 11) v;iM;t run on ti-aining pro^^r.Hu.s vliicli had no fadi.ng 
oC cuci.; during thct sc-ssionr^, Lmit \:]\o did have all posit j.onr; cucil rcgardloss 
of "tht.- prctC5;t snccc.ss or terror dnla. Table I indicaLcr. LhaL this program 
st'.qiionce for A contained six ":''ront:*' trials randomly i.ntcrrmixcd \nlh nine 
trials of the other five position:;. The program sequence; vas run on two days. 
All posit lon-s v/cre cued v/it.h a red light over the response area on tlic first 
day and v.'ith no light on tfie second day. Fig. 6 (top graph) shovjfi the pre and 

Insert Kit;. 6 Al>out Here 

posttest percent correct for each posifion (bars) and the percentage of cor- 
,rect responses during the tvo days of the program sequence (the RC row of 
figures beltn; the OLdinnte). 

During the pretests (solid bars) Subject A made errors to front (7570, 
back (3070) ^'^nd side (25?o). The program sequence contained more trials to 
front since the pretest data indicated tliat A was only 257. correct to this 
position. The posttest (dotted bars) data collect^-d over two sessions (24 
trials) indicated that A responded 1007o correctly to all relational positions. 

Subject }\ had a similar two-day sequence of no fading with all responses 
cued. Since H only had errors (637.) to behind on the first four pretests, 
that position had more trials (12) per session than the other positions (foui" 
per session). The program sequence resulted in 100% correct responding across 
both days, and Subject }I had no errors to the behind position on the posttest. 
However, a position that had not had errors previously (side) was ^responde*d to 
with 07o correct responses on the posttest. 

The program sequence of no fading v;ith all positions cued therefore re- ' 
suited in one subject (A) learning the simple relational positions to a 
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crit.ori(»ii of 100?' correct: ronjionFOs :]crc»f;s t v.'o pos L U*s fr. . Subject H, v/ho had 
ci r. iniiJ.ar proccdun^ (no faclin*; nil responses cucid) hut. n d i f f or.cut: sequence, 
improved jn the more frequently cued nriui (boliind) but. docrcosed correct: 
rcspondi.nv; i.n anoLhc:r (side). 

The. lei ck of replica Lion by Subject. II rcsulcod In ibe experi.ment er dropping 
Lhir. procedure and usin^^j ci fading technique' in subsequent programs. 

The ne^t set of subjects v/ae; in the group v:here the fading of cue lights 
or buzzer v;:is used v;ith one, tv^^o or three po£. itions only. 

Subjects 1 and H were the tv/o children run on training programs in v:nicli 
this occurred. Table T indicates that subject H ' -s second program sequence 
(third rov; from top) contained four "back" and four "behind" trials r. » '^ouily 
intermixed \/ith tv;o trials each of the four other positions. Tiie pr'; i 
sequencci v.^as run over four days, making a total of 16 tria-?'^ each fi.r back and 
behind presentations- and eight each for tlie other po:.i,tions. "Back" and "bo- 
hind" were cued v;ith a red light over the response area. The intensity of the 
light across sessions v;as faded from full briglitness to off in thrco stc;ps 
simultaneously for both positions. That is, the light over the back-behind area 
(same light and same position but v;ith different verbal labels by the cr.peri- 
menter) was faded from full intensity, to 2/3 intensity, to 1/3 t rtensi ty , 
off, for both the back and behind trials. The intensity V7as ."he sa'.ne amount 
on any one day for back or behind. This meant that both positions were faded 
at thci same t i:ne (simultaneous) rather than one position lirst and then the 
other (successive). 

Fig. 7 (bottom graph) shows the pre and posttest percent co/t'.cct for eacli 

Insert Fig. 7 , About Here 

position (bars) and the percentage of correct responses during the four days of 
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I iio prt)i;va:n r.fcjucncc (third rov/ of iinwvc.y. bcJow t.hc c'lbsc ] i: '^in) • Duriiif', the 
prc'tctfU: (sc)li(^ harrO Subjcci H nu'ido (errors to iho sidci TlOO/). The pror^ram 
sfciuoncc conlaintid rncirc Lri.rils to the bcick-behind position because an error 
nnalysl.*^ of ihc: i>rei:r';;L data indicated ( SubjocC H war. ov(ir-respondiiig Lo 
Lhc bach-behind pu.^; i. L ion . The po.^: f l.c:; t (dotlod h.;r*?) data coJlccLed over two 
.ser.:-^ions (24 trials) indicated that S.uh;i'-,:t ]{ rcsp-^-'cd 1007, correctly to all 
rclat ional |>o.s it i oni; . 

Subject I had tv;o tbreo.-step fading, program s^eqUcnces. Tabic I indicates . 
that the first prop^raiii sequence for Subject 1 V7as a three-step fading, one 
rci^ponse cued pro,^;rani v;hich contained six "front*' trials randomly intermixed 
v/ith tv;o trials each of the other five positions. "J'he program sequence was 
run over four days. Kront v;as cued witli a red light over the three-response 
areas of front (right, center,, and left front lights). The intensity of the 
light v:as faded from full illumination to out in tiireo steps j.n- four sessions. 
Fig. 7 (top graph) shows the pre and posttest percent correct for each posi- 
tic)n (bars) and the percentage of correct responses during the four sessions 
of the program sequence (third row of figures Xv: the abscissa). 

During the pretest (solid bars) Subject I made errors to front (10070, 
behind (257.), side (12.57,) and back (12.5%). The program sequence contained 
more trials to front since the pretest data indicated that I V7as zero percent 
correct to this posit on. The posttest data (dotted bars ) col lec ted over one 
Sc-si^jon (12 trials) indicated that 1 increased correct responding tu ; -nt (507.) 
and back (ICG I'i but decreased correct responding to bei^.ind (507.) and side (0?.). 

Since the first pro'gram v;as not successful (10^07. correct) in ^teaching the 
fT'ont position and in fact (on the posttest) resulted in less successfnl re- 
spondin-i, for positions beliind and side, Subject ,1 was given a second three-step ' 
fading program but with three rr^sponses (front, behind, and back) simultaneously 
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curd iniiCciil of one {nv. in the; linil i)rci;;rar.O. Tlic soquonco used during; any 
one; pro^iriim scsfji.on (Table I) had fronf piosr^ntcd six Li.racn vjliile all oLhor 
positions i.v/o t inicii; onch. (In this soqucnc.-c the order in v/hich positions v;ercj 
proscnr.od v/iis di£rc?ront froM tlie first progrnrn hut the number of tinies e^ich 
posit if)n was prcsiintcd v;ns the snme.) The pro^'.ram sequence V7iis run over four 
sessions. The front position vjas cued \oith a flasliing red light and the back 
and behind i)ositions were cued with a buzzer. Although the side position had 
errors on the prc»tcst for the second pro[^ram, it vas thought that side could 
be cued in a Inter program. Subject ] v:as still making errors v.^hen behind in- 
structions verc given, so both behind and bacli \;ere cued. ;in this program two 
different (sensory) modal it ies V7cre used for the front position (visual) and 
the back/behind position (auditory). The use of two different sensory modali- 
ties v;as for the purpose of trying to make the front and the back/behind posi- 
tions more di scr iminably different. The cuas (flashir.g red lights and huzzev) 
were faded simultaneously in three steps from full brightness to off over the 
four-day training program. Fig. 7 (middle graph) shows the pre-posttest 
percent correct for each position (bars) and the percentage of correct re- 
sponses during the four days of the program sequence (Rc rov; of figures ben"., 
tr.e absc issa) . 

During the pretests (solid bars) Subject I made errors to front (507o) , 
beliind (50%), and ->ld£i (1007,). During tne program sessions Subject I made 
an error to the iront position v/iiile the lights vjere still cuing the response. 
On the last day of the program sequence v:hen all of the fading was complete 
(totally out) errors were made to both front and side. ^ 

Posttest data (dotted bars) collected over one session indicated errors 
to front (lOOvO ^'^^ici side (50%). Since the program v;as designed to train the 
front and the back/beliind positions (not necessarily side) It is apparent that 
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Lhci prop.icin. v;;it; not: iniccesr. f u 1 . Althou;',h the bc^liind poj: i. L i.on v/;ks rc^.v-inonclecl to 
correct ly bnt li during; the pro};r.'nn nnd on t.lic f t e,s t: , The front. ]KisU ].nn con- 
Linuc'd Lo have errors .'uid \:hcn fi'iii)jccL J mcjdc an c:rror t:o front it: v;is incor- 
rect.ly made to the h:icU/h(?h i nd poMvLion. CuiisoquonL ly it: was dcjcidod ihnL a • 
Mlovcr fading procednrc; and only one poriilioti irained (front:) raciy be more 
succes refill fen* this siihjocL. 

Subjccl 1 v;fi.s Lhercforo given cj program su-Kjucncc which had seven sLeps of 
fading, and one response cued. TabJe 1 indicates t.hat f.his program seqncnce v/as 
t.b.e .sciuie as F^ubjeeL T's firr.t: fronf pro^;rai:i. The difference v;as in Ihc progrM;n 
sequence running; over eigb.L days vith fading on seven. Th.e froni: position was" 
cued by a flardiing red light: over t.he position. Fig. 8 shov;s the pre and ]H)St:- 

J.nserl: J'ig- 8 About Here 

test percent correct for ciach nosirion (bars) and the - percent age of correct 
resi>onses during the eight d^iys of the program sequence (the Rc rov; of figures 
bclov; the abscissa). Tb.e pretests (solid bars) show I made errors to front 
(100'..') and side (5070* Only one error \:as made during the entire program 
sequtincc to the beliind posiLion (not cued in this program) and side, also not 
cued, had nc« errors (the Knc row under the abscissa). The post test data 
(dotted bars) collected over two sessions (24 trials) indicatied t:hat Subject I 
responded 1007, correctly, to all relational positions. 

yhe third general training procedure involved the use of verbal instruc- 
tions by the experimenter. Five, subjects (B, D, E, G, and C) after a series of 
i>recesLs v:erc found to have one consistent error to the behind dif-ections. 
Kach subject, \/hcn behind v;as given, went to the side position of the house. 
Since these subjects demonstrated errors to only one simple relational position 
out of the six, it was decided that perhaps u simple verbal instruction of wliere 
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ihc corri'd pvJ.s i I i lui v.ms foi" boliind nuiy he c* f icuU: i vc riiul that: prof- ]'.-niij:ii.np, wr<i; 
noi: ncicC'sr.Jiry . The* procedure uiwd (T.uhi.c J) consifilod ul. I'hc cxpcn iinenter 
prcsoiU in^', n sfciunu'C t.h.^il: hdd four b.*ick nnd loin' behind i ns !:ruc: r i ons nnd two 
Lrinls c'/ich of llu v»Lher fmir positions for suhjucts P., C, D, nnd K. Subject: 
C had I lit' jjrcLc.M- .scicpu-'Uce , v;hi.ch rioanL t:hi-it" onch of t he ;:ix pos.it"i.ons wns 
prcsiMiLcd Lv/:j'co. V;h.cn tih.-^ subjccls were run on t:heir sequences, t.he first: 
error i:o Lhe behind poi^i. Lion resulLed in Lhe exper i!ncnt:cr slopping the session 
and Well I: f riT', Lo the b;icl:/b('h i ud position of ihc house. He poinl:ed to the re- 
sponse hey for Lhe behind jVTr.ition :nid tol.d Lhe child, "Here is behind, pusli 
here." Thti child then pushes! the correct key and the house chime o])erated 
along v/ith the re in forcer clown. The exper ir.u-nter then said, "From now on 
v;lien I say 1h!i i nd , push here." These ins t rue I. ions were only given once re- 
gardless of the beliavior of ench subject in that: or subsequent sessions. 

Kig. 9 i.;dicates Lhe correct responses for these four subjects o/r the 
pre-post tes t s and th.e intervening;; verbal instruction sequences. Tlie top 

Insert Fig. 9 About Here 

(subjects 13, D, and G) and bottom (Subject C) graphs show that all had 
zero percent correct responses to behind on the pretest. Once the verbal 
instruction had been given for subjects B, E, and C (top graph), they 
made no further errors on the sequences (RV and UNV rows under the abscissa). 
The post test: for the.-e subjects also v;as responded to at 1007o for all positions 
includin:; b.ehind. 

Subject C (lov:er graph), fol lending the one instance of verbal instructions 
concerning, the be*n iiid positj n, .inued to rviake a fev; errors on the sequences. 
The middle bar labeled VS under bcijind and bacrl^. indicates th\\ . errors continued 
to occur to both after the expo r inienter * s instructions. Hov;ever this subject 
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v.Ms run on I he fw.'CjucMice J'or t:hroo sossionr; iind by t 1k! Lhird ciny ihcrc v/cm;o' no 
crri»rs Lo :n\y p'^silion;] oven l:liour,h jio furrlicr iiisLrucLionn v/c-ro gi.vcii con- 
cornlnt; eitlici* behind or b.ick. The. po.sLl'(isL diila nli^o indic;.ac 1007u correct 
rar^p.'usos for nil p-j.^^ U i.unii » ..Subject: C had served c^s a trial cnul error conLrol 
i.n thc'it: iihe had been f;ivon 16 j^reios Lf. (Fig. 4) beHoro Lhese verbal insLruc- 
t ions. The c^nly oLlier error?: ChaL this Bubject had during Lhei^e prcf.esLs were 
Ln back ntid ui.de during Lhe firsr pretesL only. The following 15 pretests 
had ] 00^>;. correc L responses to bnck and side posiMon^j, VJhcn verbal Instruction 
v/as given for the behind position, this subject fhcn made errors on back by 
res po n d i r»g to s i d c . 

One of Lhct control procedures used in this e>:por inient v;as to assign a 
subject (V7itn similar errors) to an cxpcr iinentnl subject v;hilc the latter v^as 
being run on a training sequence. There v;ere three subjects used in this 
manner. In Tabl^: 1, under the conLrol subject column, it can be seen Lhat 
K served as a control for }{^ a first program; D was a control for iTs second 
program; and F as a control for Subject I. Also Subject E could be considered 
to be a control for tlie no fading - all positions cued procedure and D on F 
as controls for three step fading programs. 

■ All of the control subjects v;ere given the same sequence and instructions 
as their experimental subject except for the light and/or buzzer cue and fading 
procedures. Therefore these control subjects received thc'same number of trials 
and stimuli as their experimental counterpart but v:ere run on essentially a 
trial and error basis. If the control subject v;as correct the reinforcement 
procedures were activated as during pre and posttests. " \ 

Fig. 10 (top graph) gives the percent correct of pre-posttest and program 

Insert Fig. 10 About Here 
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session*^ f'.or su!\ic-cl \{. IJars 1, 2, and 3 nrc ihc prtit.cmL , pro^'.rnni, nnd por.f- 
tc'sl (Int el fur l'roj^L\'{in 3 (ci)l i);>ri i t. ions cuod uilli mo i'ndiui*,) niul bars 3, 4, and 
5 i'lro tlra pri'tost, pro[',)\Mii} /md pofiiLcsi data f.or ii's second pro^-'.ram (llirco st:ei^ 
f ,*Kli iij.; v;i Lli l\:o po.siiiotis cued). The lv;o boLloin ^;rnphG n^-ve tlic control dnla 
for iTr. lv;o pr()v;ra!n;j (K for Pi'ogram 1 left* p.raph; and ].) for rro[;rani 2 right' 
graph). 

CoiUrol SubjcicL K coius 5 s Icnl: 1 y nuulo cr]*ors to the behind posit-^on di'^-'-^<^ 
Lhe pj-etcst, con I: Vol .sequc:nce and posLLest, Lhus shov:ing no Iniprovernet) 
rc5;ult of t.he control sccjuencc. Also an error v;,'is in,'ide In under (second set 
of three b.irs) durlpig Lhe eont'rol sequence. V.'hon coiTipr.r Ing K to t.he experi- 
mental Subject P. it is \iot posfiiblc t:o say that the cjnirol sequence \v\^.s less 
cffect-ive sinco H made errors on the side pofiLioii --^n tl^c posllcst of Proj^^rani 1 
Hov;ever, it is clc!ar that the control sequence v.vm not more effective than the 
p j*o g r a ni s e c| u o. n c e . ■ • 

■ Control Sub^iect U (lower right graph) had two positions on tlie pretest 
(behind and side) that had errors. This subject received the control sequence 
for H's second program and as a result improved on the side position (lOOZ 
correct) but not on the beliind position (zero percent). The same sequence 
given to II under pr ogrnr.. ..ed procedures resulted in correct responding across 
all positions. U V7as not well matched to H for the second program since there 
v/as difference in the number of jjositions that had error's on the pretests 
for the :;;o subjects. However, considering the behavior of both of the con- 
trols (L! aiid D) on tliclr respective sequences, it apjjcars tiiat going through 
the. control sequences resulted in no increased correct responding ^on two 
l*)Ositlons, slightly disrupted one, and improved .one. 

Fig. 11 gives the pretest, program (or control sequence) and post test data 
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] ni^r-r : Vi^,. 1. 1 Al^vJiil. Hero 

i'ov c.'Mpiir Itnont i'}] Subjcc: ) iind co.w.io] fitihjrct V (icrops oacli simple? posit ion, 
*J*ho frf»nr v/ius the cnly por^iiiov. u\\r\cv pro^M/naxtod procr'tluros f or . Sub j oc I: 1. 
prc.>j;rii:ji for fronL v;n.s p.;M: jau'C-csii f ul :;iuco J hnd posllf-r^l' scovo of on the 

i'ronl I'Osii u-n, Hov/cvlm-, control Subject: I- <':lso did ncU: Improve nwd in fjicl: 
docronriOd in correct: rc';poncll[\r; acvosi.^ t.ho. .'M7j:,sions (j^rol est: ^^2)[\ conLrol. 
s c (pic nc o 2 A, ; po s t: t c .s ( 0 ) . 
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iriscuss lo;: 

rcl tit. j\jp..i] .'ihsl rac'l. J Piiii .i)vpcnrc'(l lo t'liU'Ci* vm'i.I) past nonuat ivo clat-O. 
r.-in<.;c of th*.' }:ul\jL'c'ts in tlis c'.\p<'r i.'nent vor.iijf in t lui nrcd i cr i J on L'hnt 

f,or".,' \Mul(1 Vf.s]><Mul <*r)rr;r!:ly to ai] llif pcsifions whiJc cjLlicrs v^'-'^Ud .sti^l 
h.-tV" sc>:;k.' I'l/iurs. i.^r 1 ; i.t.M of llu! r; i y. jk.s i. t i.oMs used ill Lhis fj'rst" 

o:-:pL r i {.it-nt tlu' ii'.Mliod Lc.st:]^); all')V.'.;d ri>r scvnc Im't licr slat ^"I'C'ut^ii t:o 

hi', mad;' tHMv.'c'}*ni ii;; Miir. descrintivo datn, 'I'lic rerailts on t:lic fir<;t four 
pr C'l'.\st. 5; ip.dicarcil thai; llic "vert, ical" or i cut a I i cni?j (iiiuU.T and t:op) 'JU'iy be 
■J cianiC'cl in i)ur cullurci earlier by mor.L prorjclux^ 1 c;rs than t ho«o t:hat. ''^oc'in l:o 
have a i':»)r(' "lior i :umi l a I " (tr ioiil al i cui (front, Ivcdiii'id, side and back)* AlfJo, 
sii!C(' behind and l^acl; \:cic locat.cd in t:bc-. iia\:u' poi^ition v.'illi respect Lc> the 
hoiiju^ but c rcf^pi^aidcd tc) d i f f f.M*c;n t i.a 1 ly by the to-br'-pi'o;-rainr)0(l snbjc'(.'{-t; 
it v/i^nld appe ar t hai t ho term back is perhap:; rriore common, ly uned v:itli pro- 
scbif)o 1 t-r «; (at least Uufsc livint; in thin section of the country), 

K>:t ended prctcirlf; on sr.vera], subj'ictr. and the relative lack of ''^Vpflap 
in pre* est oi'Cs hetv/fen t ho U'^ce groups (t o-bc-prograpinied; leara<^-^^; 
>.oro crror>;) indicated tlnat those children. v;ho consistently made noi''^ ei'Vors 
v;ould }M-r)!>c'jb 1 y acquire those abstractions only after some other t^'pe of 
injs t rue t iona I procedure than trial and error feedback, 

'J'he thrro difr»:rent training procedures used (all positions cuc^^^ with no 
f a d i n^ ; f a d i n o f s t i ] u s 1 igh t J) a nd ^ o r huz v. c r ; and vc^ rb a 1 i n s 1 1 uc t J On s ) a 1 1 
1 1 a d va r i. e d r e suits. 

On e of t v;o su b j r c t. s v;a s s uc e e s w f u ] ly \ r a i nc d wh e n no f a d i nj;; \va S Used bn t 
each pvj.f.it ion v.j:^ cued. These results coincide v/ith others (Etzel, l-^Usby^ and 
Cooper, 1971),' That is, sor.ic subjects can learn error les sly from ci'^^g ^nd 
maintain the acquisition even though fading of cues is not carried a^it, yiowevcr 
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tljc Pi iK'CiIui'c- lijj; \\o\ l)v;iMi fcniiul lo Ijo ^'f f ocl i vj.' ID)- ,'iU. chi.ldi''(i and llu.rc- 
fort' };Iku)1i1 proha!)]y iiol be I'.cm'v.i I 1 y .-jjiplicd or applied Duly in spcci.Ml civ" 
cuT.st nnc rs . 

*riu* vMri.ccl »;ucri'«;s of iltc- ftmr proy/.r/iinH run thut. luvulvcd fndin^; pro- 
cc'clin'cj^ i-ef:uiti'cl in .'u\'oriil \c cuu: I ui; i ous . The L'ick of siiccofis of Subject J * s 
three tiivp i':\d}M[\ - oi^e response cuod pnii;;rt3hi seonifi Lo bo bv.i;\: at t r ibulcul Lo 
Lbo ] i\ck oi iu.siruc'i imirjl ctuUroJ chirinp, Llic runni.n^; of lUni fiubJccL. A« a 
result of 1 ' r. beh.ivior, n Lioard on v.'bicli iv.'o "b.^qipy faces" v;cro painted was* 
placed in the rvurn. Knc.h subjecL then was insLructcd Lo sjlaiid on l.hc faces, 
t:hen on ,^i^;na]. make a responsu: and I'nun i.nip'.ed J at.e 1 y return to the board. ]n 
csscMH-e thi.f; turned I be session Into a discn.'lo trial <'xpc:r i.!::cnt , wbo'ca.'; be- 
fore- r.ui 1. 1 i )>] cj rc:;]K>nrei; \;e.rc made to one seL of Ins I rue : ions and LbiC trial and 
di rec {. lot;.'; lost tb.e advanla^;c- of a stavidaj-d 5;lartliig orientation, necessary 
in a atuc^y dealint; wit)! re.l:uiunal abr> L rac L inj; . 

Subject I's second pr(.t[^rain may not bcive liecn completely successful be- 
cause botli cues v;erc s inuil L aneous J y faded across sessions. If only the 
pro£M aiiuni n^> of one response v;as involved then tiie issue of fading?; two cu' . 
at once does not arise. For OAanplc, subject I's third progr.:if:i was successful 
when only one response was involved. However ihe number of fadin- trials vjas 
a 1 s o i nc re; a s c d so that t hi e reason for acquis i L' i o n i s no t clear. 

Subject' il's second program which had a three step fad-ing program-v7i Lb 
two responses cued did result in acquisition of all simple abstractions. 
Tluf use of tb.e sa:.;o cue for two difforen.t directions (Back and liehine) 
may hav<! :.:adc tlie two abstractions more sinilar. Therefore the subject 
responded to the same position only wlicn tiiose tv;o instructions were given. 
Verbal instructions given when only one position has errors appears to 



ruiic.l i^Ki ill a sjiiiil.ir \';iy i o ilu' nil |nr;ili.<)ns cued - no laciiii); j)rc)CC'(lur(.! , 
'Ihnt ?U'(!ic iiujl rue: I i (in:j 1 procedure; i.r, nc'cr:^s,'ii*y scc.i'j; cippnrr.iU t»ut. in sorto 
CiiiU'}- \>\i\\i\\u{\ itisi 1 net ions ni.fy be a)) i.hrM ;i]-c! nooJcJ. Su})jccl C's errors 
f>j] hv;i n^;, Vf.rl'.-il ini;U-nc:t Ions inny suj^f.cst. thcU the proccKhirc will, succeed 
-wlion only ^^TlSl P:'-'' » t. i on out: ol' ^^ronp is not coiap 1 c I c l.y /jcquirod.' If olhor 
positions arc not. i']c:]rly, d i sc j'i ininnt.cd froni l.ho one bcin;:^ l,r.':Ln(ul Lhcju 
Inr.l ruclionj.; i.^/jy load lo d hro.'fkdov:n in v;h.'if i)rt;viour/ly appeared ,Lc> be c-Jn 
accju irrd di tic r i.vii na i i on . 

'iiu* r.nhjc'cts ih.-ti ^crvod as cont:ro];; Tor y.oiuo of Lho prtj[' rams wc?:e not: 
as \'cJI !:u-.tt:d f iv "-'iHir i ii'cniial suujoci;; as would hove I)Con dosirabJc. 

liov;ovor , [hi' [ . of l.bc? conirol. Ku])joel:s on t he control soqucncos 

cilonc, ce.n i'oi..ji Mw. conclusion Lliat: oxpor^urc l:o ,-i .series of st:i:iui]i on a 
trial and ei.rvr l^jj^ic; docs nol result in any i i.viied i a acqu is i i: i on . 

The c'^* >'v*In<; out of Kxpc v i;ncnt T resulted in c-i scries of "launches" 
regnrdin:; hov; to p)-or,ram Lhe various complex positions for the same subjects 
in E>:peri:i-,cnt 1 1 . These hunches v;orc t:hen applied to a variel:y of proj^raros 
and tested on more? difficult d 1 scr inii na t: ions , 
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As.sc.f.s5;iT!cnl: nnd TrciiniDj; of Ci)Iiji>1 l-x l-.o i at ioDal Absl rnc L ions 

or llio 19 (>ri.f'.i.n:i] .subjects clcscribcJ in Kxpcr locr.i T, t v/o (ji and K) 
did ric.it pc't*l ic j.p.U c in Lxpo r i men L II due lo Lhoir v/irndrnw.-:! from the Pre- 
scli.u»] ])rior to l he running; of K>:pcrir.!'jnl .1.1. 

Afler hnvinv.; met Ihc crilcrioii of 1 OOX cor reel rcci.ond In?; Lo cil] 
pr>5;i(io!is on liic :;iinple rel/iLlon.-jl f r :?c t' i ons , .^ubjccls v:ore [;ivon t,v;o 
coi;ipl.t>: rel.::i: ion;: ] ]>rctesL« over four sequences (r.;;ikin^» n t.ot:J. of 36 Lvi;i\v.), 
Kt-:ch sequence t.er.l ed nine positions (left: side, rigliL: side, left front;, cenL-er 
. fron*-, riglu:. fronf., top left back, top left fronL, lop right" back and fop ri.ght. 
front). The occur ren.::e of the poGifions in Llie sequence -Wc-js nlternnLed bcLv;een 
lv.n> orders, A copy of t.he coniplo: pretest: dnCa sheeL is found in A].>pendix A, 
The u'.etbod c^f ndnd ni s I ra r ion nnd reinforcement' piocedure^ for the complex 
pi'et.esl are Lhe same as used in rxperimenl I. 
lU* in i iijj; 

A variety of progr^inis \;ere developed based on an error analysis of each 
subject: *s complex prct esls. The progranis v;ere designed Lo Leacli such responses 
or ask qiiesLions regarding: 1.) The acquisition of corrccL responses to a 
positior.nl instructional chain Cc.g, t:op - ri^hl: - bacl:); 2.) The use of 
successive as opposed to s iniu 1 1: aneous fading; procedures; 3,) The cffect.ive- 
ness of requiring a subject to engage in a verbal - motor chain; .) The 
effect of overla]^ in fading during successive procedures; 5.) The effect:ive- 
ncss of .differenl cues for different: positions being taught: in the same program; 
and 6,) The effect of teaching one posit ionfs) oh the acquisition of other 
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r..:iCij of V.ic .sui;ji.'Cl:s iiud thoir pr;»iM':iiv:-. v;f 1 1 be- disciis.scfl in mow. 
dc'l.-iil nl 1 }:e liioe the dcitn is prr-sotU tn"iicc: i hero nru fcv; j'CMioj\nl 
procfduM-s f:(,n:r::.)ii to /ill su!»)f-CTs. liov/t.-vcr, the Vcirii>us iM-ocociurcs U5K'd in 
1 1 1 c* f lUi i I i ; of t i ; c.' c i j t? s c i\ n h o .s 1 1 m: -iri r i 7. c c\ ci s i o 1. 1 o v s . 

Fcidiii;- ol' I jpjits (or bu?:::cr), w\\cn move t\\r,\\ ano rc^sponse v.vjs cuod, 
Vi-sf: Ciirried our und«: r I wa j^CiU-Vci I procfdiircj; : Si.;nul ( ancous chk! succcs;,' i.ve . 
■Jn s i mu I t .-iiu-ous i ni]i wy. , the :i.ntc:Ksi(y v;<:S Lhc s:\u\o nmount for cil 1* of tiie 
posit ion!: i:ei!»;: cnof!. Thuf; i?ot): po;:iLic»ns v;c-]-o f^ulc-d ihc h(Vmc lime 
(r.j;. holii v:ould l;c^ 2/3 of t!)C! c>rij;iiiaJ intcnsily on the scime dny) . In 
fuicccss i vc- ft'dinr one p^)si^io^. v::js fcidcd v,';n'.Je t.he o11icm:(<:) I'CMii^iinod af 
full inicn.sity. Vor C'.>:p/Ap] c. on c'iny one d^iy one position n:ay be dov.'n 1/3 
of [he ov^lii^i^x] i n t c* ns ij:^>y v;l; i 1 c t;ho olhe?' is sL'i.ll pA' full i n t;ons i. t.y . There 
\:ns i\li,o d nli^^iit v;i :* i :i t i on of proccdin'G bcLvofjn subject's ll'iat v;cro on 
successive f;Klini»,. Some subjecLs hcid c^r. oveflc'ip in fading on i.v;o positions 
v/hile others hr,d tof.al fading of one position before fhe olhcL' posil:ion lighL 
or "bu;-'.xer slrirted to dccrensc in iiif tensity . For ex.-anple, if overlap occurred 
in successive fodin;; i.hen one posit:ion vjould hcive faded to Lolally out: v;hilc 
the other position lig'nt: would have started it's fading down to 1/3 of its 
original 1 intensify vn.tliin the same session. 

Yhe training', desip.n for Experiment TJ v;as basically the same as that , 
uF.e.d in Kxpei'i r.ient 7. V}:at is, eacii progra::i or control sequence v;as 
e v a 1 u c3 i e d b y a pre- p o 5; t t est p r o c e d u r e ; s o iii e p r l» j.; r a ni s were r u n on • mo r e t h a n 
0!}e ch vid; ai*.d control, subjects v;ere run on control sequences at the time 
tiie exj)er i:.;c-ntn 1 subjects v;ere being tun. Tabl.^ II suiumarizes the experimental 
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hir.Lory f(.»r i:.i\<:\\ 'i>w[\v\\\ did luM pi-mm c r i t <.m: ion mi fJiO couipio: ro } I j.o:i:i ] 

pretexts. 
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or the J.7 5:iiI>;)C'c:Ls i ;!c i f i od by IcLtors friMn A throu['li S (I'lg. 12), 

1 1 : 1.; 0 z- 1: 1 * i i;!; . 1 2 A h owl Wci' o 

76Z or over three fuiirllir; t):L' popu 1 ii l i on wcj'o p1.*>f:ccl in (he lo-bc- 
prc))>;vr<n.^-iic(l £;re'Ji) si.r.cc Llicy die! not obl:iin J 00/1 corrccL responses on their 
Inst: pretest (:,v;o sec|uei7ces) . Tliis i'.ro^ip (siibjec f.;? A ihrough 0) hud a 
menn ef .'i-VZ. coritrci re^poures t:o Lhe ec>i;^jjl e;-: positions of left side, riglii. 
side, Icjft. rrc.^nl, rlv;Mf front, ccMiLer fron! , top left hack, lop IcfL front, 
I o p r i ^.d 1 ■ b n c i V , r: i : d v o p r i g! i L fro :i t , v;h i 1 e their i n d i. v i. d u n .1 i )e r c C! n f ge s r ci n e d 
from J A to 727. 

Snh.ject.^ }\Q, r'jnd K (18Z of Lhe lotri] group) li-.et. Llie criterion of 100/; 
cori-eci rcspondiiii^; on two successive sc-^quences of the pret'.csts. Tliese subjects 
mean v.'iis 877, on the 36 trials v;it*.]i irtdividunl percentages ranging; from 815 to 
9*>Z. No subject f rcnn the To-zie-Progr^iiarned group., l^nd an iudividuni percentage 
correct nr? high as the lo\7er perceiitage correct in the subjc?cts v;ho learned 
group. 

One subject (S) made no errors during the pj*e tests. Of the 17 cliildren in 
this study more than 3/4 (77/i) had very few consistently correct responses to 
the coi.iT^lex positioTis. 

Fig.* 13 shov;s percent correct" for each of the two co nip ley. pretests 

Insert }•* i g . 13 Abo u t Here 

I 

ffour sequences) for individual subjects in the To-Be-Prograin:iied and Learned 
groups. "ihe three subjects wiio were placed in the learned group (lower rov; 
of three graphs) tended to hiave initially iiigher percentages of correct 
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le.spjnst'f. and tlic i.iort.' lypicnJ. acq ii i s i ( i on ciii'vcii. The t a-bc*-pro[\r*V!i;;iiocl 
[;r()'jp (.cM:drd lo luvcj f .'n* r I y fl.-it c;.in-Vi'5;^ sli^y-i ''T. no t riitul'j toward accju i 5i i ( i on 
t-!cr(.»ss tlic pro I est'*;, 

VUj,, proscnl s ila(..i from addjiicnial prcMoslr, ^»ivon lo iiubjcicts D, 

l ! Ks 0 1; l ]■• i . ] A) > c> l* { ! 1 C' r v 

anc! frcv.o tiiL' I o-bc'-proj.',r.!:;riicd ^^rouj^. All of t:iio 5,:ubjc»cl;s cxcopL 
N siiCTv^c-d an im-.rcnHC. in pcrccnl cf>rri'cl on l.hc addi i. jonnl pririosfs, Tbrco 
of tt:c» fivo tondod ro Jcvcl out. or dt-:cror;st.' afler trn's incronr.c. no\;cvcr, no 
subject: fror.i ibis group *rc?:.icbod ci pcrc:cni:np,e equal l:o Lbal of tbe lowcsl' 
irid i %' i dna 1 pc-rcciit aj»e o) I 'nc? ['.ronp of subjecr.s v/lio learned, 

Kig. }.5 sbov.'s ibc ]>erc:cnL cortccL on ad<l.U;ionnl preter^Ls for Lbose subiecLs 

InserL Viv,, 15 About Here 

v;bo Icarnofl. Afler acliievinc; 100/. correct, responding no subject: from l-bis 
^^roup ever i-iade an error even t:boiif;b ihe addiLiona] prel'esfs numbered as many 
as 14. 

Fig. 16 sbows ibe percent: correct across iv;o pielcst (four sequences) 

Insert . Fig 16 About: Mere ' 

by posiLion for tbc subjectis t:o -be -p rogrannied and subjecLs who learned. Tbe 
data a3--2 plotted by each complex relational position on eacb of tlic four 
sequences of tbe t.v:o pretest. The dotted lines represent the data for the 
subjects w!io learned and the solid curve for the subjects to-be-^.^rogra".l;ned . 
Tiie one position v;i. th the least discrepancy between the two populations was 
center front.- The four top related positions show the greatest discrepancy 
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lu'tv.'con the Lv.'o j',r(»ups. \J1h.m: t 1h» prrtcjil: cJiiln v/ns nivilyy.od it incJicMtcd 
that tliC! chiicircn ( o-bo-jiriJi'^'ninmotl wore not?- lospvuicl i nj; I'o llici "Top" ]i.:rrl 
oT the verbal i lu; ( I'lic. L i cm r? ''e.f;. 'lop l:ir!,hf i'jck) , v:Iicrctri.s Lhc s\ibjciCl5.; v;ha 
\.H:re rC'Spotul i ii;; to Lhc I In ivo posil ionnl i r.s t I'lic: 1 i on s . 

P)*oL'C'.sl cr rcu' riorj 1 ys J .s indicat ed ihML the t o-bo-pi-o^v.r.-iinir.CMi rjuh jc:cts had 
the t:j(i!U. di.rr jc'vj].l:y \7i t h the lop positions. T'nonf MCirc. the- cnly por.it ions 
that. ci)nt:M 1 ned ' t.h rcv' tcrr.is (.-ill olhc.v comple:-: 5;i i: i mn 1 i c on L n i pcd 't wo) . It; 
v;:i.s ijlso .Tppiiicn ihcit flu; lo-be-iu o;'.rfi::i:r.od Kubjc'c:t.s tended fo respond prininri.ly 
to the hncl-./inli 1 nd posiLi(»n v/hon ins I rue f i ons for lop- 1 o f t. -hnck or t.op- r i [^:h I. - 
bc^ek v;cTe ^^/Ivci'i. Conscqncu t 1 y tv;a subjec:L5j (O an.d K) wlio luit.h dciv.onH L ra t c d 
ihiK error p:atcrn v;hen ^^^^ ^'^^1' i ns t. rue L i ons v:crG chosen for st:ndy. 

0 reeeived ;i top- r i <:;h t - I:)Mt:k program ('iiible I la. second rov;) v.'hlle E served 
nr; the control. The prop.rain sequence v.-as given over six sessions wit)) five 
steps of fading; on t.he fl.'.ishin^; red }ij;ht. The light and flie response key 
vej-e loeaf.ed on top of L'ne voof of tbiC house, and on Lhc left* back side of 
Llie slanting roof. A pro^;rar?) sequence consisted of five t:rials of tzop- 
r i.^;!it -back and one each of the other complex posit ions (except for Lop-left 
front: whicli iiad Lv7o trials each). 

Fig. 17 presents the pre-postt est: and progi'am data for subject 0 and 

Insert I'i^. 17 About :iere 

tlu' ccmtrol sequence and program for subioef E. Subject 0 liad no correct 
respor.ses on Lhc pretest: while E had only 257, correct. The program was 
resp'OP.ded to ]007. correct ly across Lhe six sessions -by subject 0, while 
the conirol sequence had 207^.correcL responses, by E. The post t.est for 0 
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rt'ia-tinod .-.il. 100/. correct re sp.jtui i in; \A\ilc 1.: cont i.Muad nl ?.!37. 

Siibjc'Cl ): v.vis Lhen vjvcw iho i'nv.ic r.cirivs <;oqi!cnr <»s bvl ihir^ linin wiLh 
(he cnc'S nncl fridlnp. pvoccnlu rc?5 . Ilu! pi ci^;rniu nnd pL^stlci.t. v;urc responded lo nl 
llic lOO'i crUci-ion level. 

A serir-i; of diffcreii: pos-lLionnl pro^.^.riiniF; v;ere carried (>i>» with either 
siinu J t arieuiJf. or iniceesf:ive radin^; procedures. Tiirce sid:)jeci..s (J, 1.,. nnd D) 
received ci s iir/.i 1 l.cineous ly f.nded prOipTun for rij^hl f roiU.-ceiU; c-r fronl: ntid left 
side - rip.iiL in'tle. Ovi of ihe liircc proi;rcinis one v.m.s j^uccesfifu] in lenching 
Liic discrimiHtii ion. IS (To)- Subjecf. .1) ruul Vi[\. 19 ( f or 53ul;> j ec L L nnd 

])) show t!K' pre-posLL est s :ind pro^;r:im diMo . For Suhjocl.s I, c\ud .1 the sirnul- 

InsCM-l Figures IS and 19 About Mere 

t:c*in(?ous progrr.r.* v;:if; prosenfed l:ir5;t. in l:heir expor imenfnl hir.lor)'. SubjecL 

I) first served ns a con!.vol for I. l:hen vr.a trciined on 1/ s simult; nneons pro- 
grain. Jl Vci.s this IciLtcv subject: v:ho5;c pro{Mrnin and posllcsL responses: indicated 
LhaL lb,e discriminrji: ion was learned. 

There v;ere nine successive] y faded programs run on IcfL side - rigiiL side; 
top lefL - top rir^ht; riglit front: - center front:; and top loft" back - top 
right back. Subject J ' s second and third program.^ (Fig. 18); Subject: 1/ s 
second program (Fig. 19); Subject: 1 and D (Fig. 20); Subject" W and N (Fig. 21); 
and Subject A and K (Fig. 22); all had successive programs v?!-.ere the fading was 

Insert Fignres 20, 21, and 22 About Mere 

not carried our ~ the tv;o cues at the same time. Out of these nine programs 
seven were sue. juI while two (Subjects A and L; Figures 22 and 19) im- 
proved their post test over the pretest but not. to the 1 007o criterion level. 
Although the successive programs t'as compared Lo the simultaneous progrr/ms) 

i09 



a'lM^^*'^^ ^-^^ hnvv had a l;;5'lio.)' ,sik'c (i.'i!; ral ii), llu io v/urc ci varit-ly oi" otiioi: 
v.-iriribloM that: mnv 1k';v<* ci'J.crtcu thcMO I'csults, One i i; ^' J I ar \-'as iJ.e 
nuiiiber of s(*ssions jjUM^.vcc! i.n the* p)*or I'durc s , J'or CMaiiiplc fiiucc iadiai' 

oC hoth i*iu'?; v/a.s cnri/icd vu\ f; i i;iu 1 t ancon.-: 1 y thi'Mi flic nutv.hLT of st-issionr-; Tor 
a 1 1. f; liiui It nnc'LUiii proy^van*: vraf; ft>ur. On Lhc oiiicr hand t.ho siu.cc*;s I vo pro- 
^»,rai:i5; iiad ci t.hor i>r r.ovcn sosm i onr; . 

Hol.h prcM' raii!:!]! Vij'^ aud iri.al and error pro::'::dii]'os thai, have included a 
ciiainc'd )*i\spc»nse liave found Lhal successful resi'ond j nj» is ur.unJly increased 
by Lhii: Irchnifjue, ']V;o .subjeet.r, (L n;ui M) \.'cve c|,iveu prov,raiiis v.'hich included 
a requirid v'crhnJ rc.spunr:e. Ijefon^ lhc "j't''" »i{;hL vntrd: on Lhc jiid^icct" hail la 
[;lve a verbal rer.i?;)nr.e . Subject b (ri?'» 19) liad I'nis iet|ulrcd verbal resjK)!ise 
added to i>i-e»;;]a:.is i.hr(?c and four. I'or oxai;i})It^, cm pr();\ra'.n tlircc: when l:hc 
cxpcr j.;hi*:n L cr g.n\'e t he. inslruc t jora": flu* subject had to repeat the pujji.tion 
bcforu l\ic lii;hL vcuild couic; on, tli.u?^ iioriai'L: f J ng fiiC subject to thc^n 

respond. Jn i)roj''.raiii four only lhc left front poiMtion had the verbal cliain 
connecled to Ibe procedure. Subject M (Fiv;. 23) v/as succctJsful in learning 

Insert Fig. 23 Abcuif Here 

the left front - rigiit: front discrimination v;hon the verbal cbain v:as in- 
serted prior to the pushing (motor) responsc-r^ The use of fJie required verbal 
response in each c»f the programs v;as under slightly dif forv:nt conditions. For 
Subject b ia program three if was added to the sequence \:hen only one response. 
v;as be in?, cued, Jn program four it v;as fhc luani pu 1 a f ion for the left front 
response v/hi I.e t:be flashing light cued the right front response. Subject M 
bad a Slice ess.ive prograr.i when both flashing light and huy.y.cr v;ere cues for 
right fron( and jeft front respectively with the verbol-inotor chain being tied 
t:o the left front position and no verbal response to Lhc right front position. 
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Ju .'ill prv);;r.'K.!:'' wIkm'c (.1m.^: v<*rl>nl cli.n'M v;;m- ruKU^d I or v.'.'i.s I only |M'tuH'diiro, 
Ihc Niil'Jocl. Ic'inu'il Liu- pcM! i L .1 ot^ lu KU);, cri l iTidii, U-^iihouJtl bv' not.od that 

• Si. 

thrive ^ic'jsions oi' l nyA'rwc [ lowi. |)rcct'« d: ^1 the JOJl. fi'oiU: - rij-ht.. front i^i-o^j.raiu 
(Kij'.' -.'0 Snlj)rc:l M, Tlii;; \/ai> ci sjiiiilru* procculrjo Ms UiJC-d with iionu^ Mil)jc'CL.s 
dviri.iij', I he i';jin|>li' ]>]:()j;r.-i;*;.s . 11ov;l»voi.* >. I he ])ri'fu''f;»;uui vorl.K'i 1 i n/: t. rucM.. ions \:c\c 
i\iv('U feu- i:\:»> I^'m'. f 1. 1 on.s (rxi\ opposed l.o one duj-jnj'. I ho .slini)lc iiroj'.rnnis) , left: 
front; v*nul ri^^lH' rroni:. iho i.n.s l rucM- ion.^: :i Lso included Llui dc'iiu>nrm:;il Icni uf t.he 
jJofilL jiMi, Tnif' iMoc'C'ciurL' did not: result in ;iny correct: rL':;]H')n.';os (on IcfL and 
ri'jir. Ironl:) ^nul thcrctorc (he ]-)rcu',ra;n v;ith che verha 1 -iuotor ch.'iin v;ns ?;iven. 
The Icick ol' .'Uiccess v;i t h this i Ui; t. I'uc I i onn I j^voccdure laay have been due 1:0 (he 
f tic I; ' I ha t I va> (no(- cnu:) r>e\s J t' i o:rs v;ert? ue3a\^; j n.s I: rue I ed , 

Tlie c|ue5-.l. i.on of v.'het:hev or not: tihe ovcrlappi nj* of fadin^^ by t*he Lwo cues on 
n pror.ratn v/ou^d d;i.r;rupl tlic: behavior dur.in^; a i)rop,ra!n v;ai; con.sidered. The dal:n 
i.nciicate. thai out of five in'o[;ra!iis that: had overlaj) t:hi:c50 rcsul l:ed in no disrup- 
tion of behavior (hiring; t;he prLvoram (Subjects 1), II, and N, Fij;.ures 20 and 21 
respectively). In contrast;, of the propj-np.^c; that had no overla)i of fadin;; on 
the cuc*s, four were successful, and one. v/as not, 'Jhe four projv'^'-ns that did not 
disrupt behavior cUn-in^ tlic in-oj-rani vjcre run on Subjeces M, A, K, and J; Figures 
23, 22, nnd KS . Fi'oia these results it: would appear that no consisLent trent 
appearcid since both prc.^cedui'cs v;cre a]i:K»st equally successful, 

•There v;ere ten pro^u'anis that utilised diTfeL-ent cues (lirJiL or buz;<er) when 
tcacln'nj^', nore Lh.an one jxisilicm. Also t;lujre were four prograiiis that, had the same 
cue for tv:o differenL positions. Those subjects 'that had prc\r;ra-\s with the same 
cues (J, [), and h; rioures 18 and 19) for both i^osirions had a 30-v50 chance of 
success. C)n the other hand v.dicre different cues for different jJosiLions were 
used the ratio i::*.])roved to 737. correcL (Subjects J, 1, D, II, M, N, K, L, and A; rij;ures 
IS Lhrc)u-h 23) . 
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Thr \ii:A. .-inaly.slt, uimIt on I coiiciTiuul the I'frcct. i»j t.lu* necju i ;i i 

Li(Mi {'( <MU* or L!-'>v(' rc'l af i I t j.\j(M i on:; on I'.hc ;;{".tiu1 s i, I i Oi of ollior 
coiiiplcx ahfi I. i'tic I J our. . In {!k' i.tic t ts'i jic* .nul tlocro/^.^c of pt-rcnMU" con'ocl: 

j n^ c v I V I V', . T'-'f Ahou I He r(» 

rc?spoii.:vn> f rt.K:i pre! oi; ry. *o final pc**;! ( <\s l r. on nonin"o;»,ran;:iic"Ll sLii.ailj is plollcici, 
iMu' scMJC'S of bars on lla' left \:cyc 1 1 oJ' tlio cy.por iiiiant:al (In'U.cliccl) subjocls 
rincl the ir controls (d.aU'd h:ns). T'no f;u]- jcc t:r, on Ihc ri.^'jit wcro Ihosc t:ha!: 
1 1 a l1 no c: o n c r o 1 s \; i I i i I. h c i. r ] ► i" o j'. r a i/. . T i i ci a I n v.' a s c m ] c \\ I a Led by L a k j ii j; a 1 I. o f 
Lho posit i.onal iiinr. on ibo conplcx p^'ctcj;!. (:hat: wcrt nol bein^'. subr.oquon L 1 y pro- 
j'ra:;i;;!:"(i and ar r :i \- i ii,; a (■ a jicrcont corrt.'Ct for I liosc iLoias only, Tbcn aJ.Ler t.ho 
pro[»rvi:ii, a jH'rci.-nt c* .jr rcc t: for llioso sair.c iionpro^';rar.:ri;c'd il.cms v;ris obtajnod, 
Tbcse tv:o porconia;.;ec; v;erc l.hon so.bLracLrd sc* llial: ii I; be pos ta:t:s f. pore en la^'.e 
was .lai j-'.cT on Llio. non|n oj.;rai!v..iod j.Lcnis tlion tlio dj rfcrence v;as assi.j;ned a plus and 
was j>l.ol:tcd on flu* upper side of tbc abscissa. If Lhc po rc cn l:aj',o of nonprof.rani- 
mc.d j.loias was lar^-cr on ihv proles I f.ben l:bcf perconLrii^o v^is ass.ir.nod a minus and 
plot: led on f.be b'jt:Lc>i;! si.dc^ of l.bc^ abscissa. Tor exainplo Subject: A (iho first"- 
bar) incrca.->od correcL rcspondinj^ ^i27o on nonpro[;rainmed items froin t:be prcl:csL i:o 
tbc postt.osf. Howevor A's conLroI lost lOZ correct. rcspondinj> on nonpropjrammod 
items. Subject' 11 (oxpc-riiucnta 1 ) increased 307. v;bi].e ll's control decreased 57o, 
Subject 0 increased 227,. }Iov;ever, O's control also increased (35%) and by a 
lar^^^cr a::^:^unt. This increase, in correct responding on nonin;.Qf;i.vir.inied items by 
tbis control sr.bjeet v/as tbe only increase observed (>n tbe part of a contro] 
subject. That is, except for tbis subject, controls eitber lost or sbowed no 
difference (e,^;,. Subject D) betv;een pre and posttests. 

On the other band, subjecf.s who !>a(i an intervening proi^rarii clearly shov/ed 
increases also in correct resjK^nd in^', on nont rained positional items. Out of 12 
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(IrcTiMiu: Inw] ]>vc\ to posUi'lUs ou II on pr o^; T .•iin;;h:u! Mijnu.l.i. lIowrViM', this same 

5-.nih J'.'C'l on lalor j)rov',r;ir!'; d'd show tranr;fcM- ori"c"<:ts. 

Thu; (•flt'Ct; secnucul t.o Isold vdioflior or not: iho noir.n'ofjMMried st ii-ui.l 1 v;c'r(^ 

also prfinint'od iujC t.r.?,hu»d) "In t lic^ prof^va::! (l>eLv.\'C'n ilio pru~iujju t:cf;l.>;) or 

\;lu.'t liur llic! suhjcel had no oxpct i onro v;i.th (.jxcupl on t ho pro-post Lo:'t.tt. 

:tsl:orj.sk (''•) under Subjoc.t: 0 and il's bari; ;uid a.1so under 1.^^ and (or 

control st^quoncc/s for Suhjoct ll) indiv\''ite v.durrL* the pro;^;,rainf-; contai)K'd tlitiso 

nonpro>;r;i;i;nied iLcns. All other pvop.rriins by the. othcj- subj^-cts on th(^ j?;raph 

contained only the complex posit, lonal item that \.'as beinn pro[',raniracd nnd 

.si::i;)le. po.-itional iter.uT that the :;.ubj(M:t liad already acquired. 

Onc! further eva;:ij>li\ of hov.' acqui sit :\on of cor.o coniijle:-; relational d:is~ 

crlininalionL; \:ill effect otb.ers is soon in Tip;, The jp*aph is a sunmary of 

• 

In.*-:ert Tii\. 23 About Here 

Subject J'i; cxperiiiuintal history on tlie complex stiiiuili. Subject J had l.lu-ca 
pro^'j*;Hns, tv.-o on the center front - right front positions and one on the to]) 
left back - top right back positions. As a result of these programs the per- 
centage of correct responses on other' positions incrcciscd across the four sets 
of tests until on the last test (number four) ltII positions v;Grc being responded 
to nt 100% correct (indicated by the liatchcd square) with tlic exception of the 
left front position that v;as 75% on the final test. The effects of these three 
pr-ograras v/as most clearly seen on such other positions as top left front - top 
rigljt froat; Jeft side - right side and left front. Since none of these were 
ever ]jrogr aiirned it v;ouJ.d seen that training on some positions did influence the 
acquisition of other coinplo: positions. 
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i\, J i'u ( , r'H»?:>i« t ypo."^'. nl )'f 1 cii i (Mwi 1 posit K)nri nuo'u tlifliculi I'o)' 

♦JchooliM ^ in the ilirvi* i'uur ycfir riiniu*, Kxf cndoil pin t usl r no{ I'c.sull 

in awy L'hsH* /ictpi i 1 m' uii . lloai of the cliiJilrcu d i tl ntt( cvoi )'i'}>poiuI Ici tho 
i:ii[.i;»J im.i -t ilirir Cciii por.iiicHi.il tl i ri-c I i ( »n , llic ;inalyj;is oi* n vuricly 
oi error p.'ii UTus aiul soirc- pru;',rar.i:;ri nw. isiioci; rnfjiod i n' J-xpcrn'iuonL 1 rcrailicd 
in fi .sorlc-r^ nf (|Ui;.s{ i our; Ijcinv; ;ibi:c;cl v»lijh» prnt;i v.hm'C bciui^ cons ( rue I cd 
to t c-ao!) I lu' coi^pit x j*ol»ii ions. Ono pro;;'rai!i v.vis cUvvclopecl t o iraiii fi fiubjoct 
li> co:.:C' niidcrr the cont rt»] cM' ] 1 l.hi'oo sl.i'.:iulu8 1 on:is* in a complex cI i.i'ec I i on . 
YhLs w.]s t'l fuK-t'os.s f 11 1 proj;r.'n;i niul p.'n.'l of this iii.*:y be duo l.o the fact: Lbal, 
onl y (uv.' eo;np]e>: p. '.s i I ion v:aj; bcln[^ pro[;rainn'.ecl rat her ( ban a d Isc i i mi na I i on 
belv/cen Iw) coinplo;-: abr. L rac t ior.5i \;illn'.n the same proi-ram (nnch as top rj.j;bt 
bacb. • top ]e.(:t bach.). however, IL apprars to be a fairly easy prc)Codore to 
bri.n^,; a c'ni.ld inider the ccMitro] of a three term rclal ional abr.Lract.ion and 
once thi v. respc)nj:e is acquired then discrii'iinal; ions bet.v;een .several t hree 
Lena abstract: ions conld Ik: proc'.ranped . 

The more success fnl pro^;ra;ns seemed t o be t hose that- vere designed so 
thai successive fading of cues occurred rather than a simultaneous fading*. 
The actual, reason fc^r this hov:ever v;as not inves t if.ated in this study and 
reiuaiuci a problem for future experimentation, Tiie variables that may have 
effected the rt.'se.lts could have been: number of sessions (v;:n'.ch v.'orc Jon;:'.er 
f o r t i 1 1: s u c c e s s i v e p r o t», v a s ) ; o n 1 y o n e f a d i n g p r o c e s s o c c u i: r i r.,e, a t a t i ii^e 
and t!iert:fore t *ne subject may b.ave been more likely to have I i*ai}s f e rred 
cont rtU of the cue to the actual coir.plcx stimulus position; different or same 
cues for different stitnulus positions; tiu* order in vbicli a subject received 
the .simultaneous or successive proi-ram (e.g., first or second in cxpcr ir.enta 1 
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hi.v.LcM-y). 'Jlicr.o Inttcr vcn-inhJ os v;crc not; s ys I emat i cnl ly coniroJlod nnd 
coulc! liavc ;ui rii)iiled to ihc va7*iancc in snpo rcspoct. 

.Siiccc?.«>si vc- fiidinj^;, cTs carried out in most' of {\\csc pi'of/.ra^ws., seems more 
lil:clv io succeed. Also it. does not* ap;>e;3r LliaL a .sligliL ovei-lcip in the fading 
proce.Hrie.s of l wo cues v;il] result in proiu'^m errors. Con.sequent. ly , t:hcre niny 
ho :i poinL soir.ev/liere l/e(v;een co:;^pleLe overlap (siinul. Laneous fading) and a one 
se.^sion overlap in tlie fading of tV70 cues vSiere opt i:nal learning; vill occur 
and yet. v:itii naKiimMii efficieney (fev;er Lrials or sessions). 

The addil ional requircmenL of n verl>a I-not:or chain in Lhe responding Lo 
a proj',rainnied sec]iu?.ice r.iay ne a nicLhod of adding a stimulus (l)ic suhjecf.'s ovjn 
verbal] response) to hc^lp c ue vesp:vises. This procedure should be invesLijv'^t od 
further since if has the advantage oi* Llse subject almost: carrying his or her 
ov.Mi stimulus with him Lo use when other cues may )iave faded out or been 
removed. 

The fact tlial cliildren v.'lio V7erc program:ned in complex re]al:ional absLrac- 
tions also gave evidence of acquiring oLher (nontraincd) absLractions (wliile 
the controls did not) tends to emphasise the following position. It is not 
so mucli the *'devcl opmental level the "readiness factor" or some neuro- 
logical growth or lack thereof that determines whether or noL a three or 
four year old can learn complex relational abstractions. Rather, it is hov; 
one ai-ranges the learning environment. 
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FOO'i'NOTKS 

1 

Thi5: sLucIy v.\-u-. .suppovLcd in pnrL t:Iirou;;li the; Univcrsi.fy of ICansas 
CcnliT for Hcr.e:irc:l; in H:vrJy Clliildhood Fclnca t: J on , i.n assoc::i.f'it. ion \:±th 
l:ha United SLal»'.'; On'Jcc of luIucaLion (CTMRKL, Inc., HranL Nu:nbcr55 
OKC 3-7-070706-3118 and OKC 0-70-^U52 607). 

2 

The fnuini-; of .l.i.j^hlr, and bnx./or v;:i.s accoir.})] islicd hy the use of c:a].i- 
bi'al.cnl pol.enLit^r.''rl:erf;, In thcr case, of tiio light, f.o dccrea.sc:^ thui 
intc:M:;.ity equa.lly ac:ro.s5^ trhc r:iiij?,e froi^} full ilJumiiiation to totally 
out, a ligh.t ban); coasii;tjn^ of three lights \7as built Jiito a conti^ol 
ho :•: . Til is b an k o f 3 i j:,h t s wa s v; i r e d i n s c. v le s v;i t h the potent i. oin e t e r 
and each light could be put into the circuit indcpesideutly by switches. 
Til -is iillovvcd the f'.ainc current drairiaf^^e if four, tlirce or two li^^hts 
v/ero on (e.g. . when side wn^ cued tvo Ijf^hts w.rc illuminated c:i the 
house .'iiid tv;o li^^lits v/erc illuninated on the control board, giving a 
current drainage equal to four lights) . The cal.ibrntion v;as then carried 
out by turnirig the potentio'tietcr until thiO lights that were to be cues 
were visually out. Tiicn the- nuniber of steps that were to be tlie 
fading sequence v:ere divided into the number that the potentiometer 
pointed to on its own scale at totally out position. For ey.aiiiple, 
if the lights v;ere visually out at point 30 on the potentionietci: scale 
and tlie jirogram called for tiirce fading steps, then the first fading 
step moved fro:n zuro (or full intensity) to 10, the second to 20 and 
the tlurd to 30. The buz/jer was faded in a similar nianncr.^ The lights 
upon v;hich the fading and caJibration was carried out vjcre G-K 1819, 28v., 
.OA a;:ips. The buzzer was con struct Lid in i^ha shop by the experi.Tnenter 
and was basically a 6v oscillator nodule wired in conjunction v.'ith a 
PM speaker. 
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1^;. 1: Tcrccnt correct on four siiViplc rGl;-iticnal pretests for 
sul^jccts-to-l^c-prcgraiuined , for subjects wlio learned and 
for s u b j c: c t s w 1 1 o h a d z e r o e ]• xors, 'Jli e range r-i ve r a g c; s an d 
means, for the three groups are given in the boxes. The 
bars are of individual percenta^^es . 
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F.lg.- 2: Individual pvi;rceut correct of simple rclacional concepts ocr'oss 

i 

f on r ]u; CI I: c J r t : by j ;r ou p s , s ii b j c c t s to be p r o t^r < jrun ed n n d u b j o. c 1 5; 
v:ho learned through protests. 
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Percent Corrccf of Si;T;p!8 Reiatioiial Concepts 
Across Four Protests for Individual Subjects 
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K'g. 3: Puircant correct: and individual comparison across subj cc Us- to- 
bc-prograuimed and sub -j acts vzho learned on first four pretest's 
and additiona.l pretcst5> of simple relational concepts. 
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Fig. : SimplG relational concapLs perccnil: correct: across extended 
pretest for Subjects B ami C. 
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i^, 5: RoIciL.ioual concept: po.s;i.t:ion porceuL correct across four pro- 
tc.fjts for subj octs-- t:o-bc~prc>[^ram:necI and Kubjccl.-i v/ho learned 
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Fig. 6: Subjects A and I] percent, corrocl' on pre-rind por.tl:esL' and 
intojrvoning pro[;rani (no fading, all rosponsns cued). 
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Fig. 7: Percenl. c.ori'ec.L on pre- *'iiiu jJosLtcst and inLervoininp. program 
v:liicli tlireo. step fading \:ns usod for Subjects I and IL 
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Percent CorrecA on Pre -and Posttests 
Intervening ProgmfTi : Three 'S[op Fading 
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Fi^!:. 8: I'crcent correct an jirc- anc] posri:c::;t: and a nLcrvcnlnp, prciu'fUii 
(I'rontiJ .in v:hic:h scvun sLep fadiu[; v:ar> u5;Gd jOor Sub;jecU I. 
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Percoiit Correct On Pre andPosttests 
Intorvoning Program: Seven Stop Fading, One 
Rosponso Cued 
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rip,, 9: Fercoat: correct: on pre-- and poj.^t: test, fur SubjocLt? (J', D, K 
and G) liavxng i.nLcrvoning vcrb^jJ. iniitriicLions. 
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ri[;. 11: Comparison of Lhrac sto.p frjcling pro[;rai:i and nonpro^prainnioc] 
(Coniirol) fteqiiences for Subj cct I , 
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Fip,. .12: I'crcont: corrGct on t:v;o coinplo: rclalioun] pretests (four sequences) 
for ,sul)'jeclK'-tO'-bc-pro|;rnin;:!Cd , for subjects \\'ho learned and for subjects 
v/no bad zero errors. Tbe range average me^ns for tbe tbree groups are 
given in tbe bo.\es. Tlie bars ore of indj.viduai percentages. 
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Fig, 13: Individual pcrconl; correct of complex relational concepts across two 
pretests (four sequences) ]>y groups > sub jects- to -be- programmed and subjects 
v;lio learned throu?.^h pretests. 
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Fig. rci'ceni: correct on first: tv7o pretests and additional pretests for 

individual subjectis on coiTiplex relational concepts. 
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Fig. 13: Percent coirrcct: on additional complex pretiests for subjects v/lio 
Icnrned on first: two pretests. 
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t 



Fig, IG : rarcc.nt correct: across tv70 pretests (four sequences) Tor subjects- 
to-bc-progrcnnincd cmd subjccLs v;ho learned during pretests. 
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Fig. 17: Cc)inparl«oa of progrnmip.Gd and nonprogrammed (conti-ol) sequences for 
Subject 0 (Top ivight; Br.ck) progr.Tm. 
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Fi^, 38: Pcrccrr correct: on pre-pontCosC and int.Grvcning programs (Rlgn. 
Froi-it:/Cc::l('r froni, Top Right; ])ac\-jTop Left: BcHck) for Subject: J, 
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Fig. 19: Coriiparir.on of pro[:raTrmied (Left Sxde/Uight Side ~ Left Front /Right 
Front) and nonpr ograninicd (control) sequences for Subject L. 
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Fig. 20: Comparirjon of prograinnied (Left Side/Rlghl: Side) nnd nonprogi-.-immcd 
(control) saqueitccy for Subject; 1. 
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Fig. 21: Comparison of prograinnicd (Top Left/Top Right:) and nonprogrammGd 
(conti-ol) sequences for Subject: II. 
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Fig. 22: Comparison of programmed (l.oft: Side/Uiglu: Side) and nonprograinmcd 
(couLrol) scujuanccs for Subject A. 
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]"lg. 23: Percent: correct: on p);e-postt:cKt, and inliervcnlng program (Left Front:/ 
Ki[:;lit: I'ronL) for .SubjocL M. 



ERIC 



258 



O 

>- -C 
D- CT, 

Cf) 111 

•E u) 
to 

CD C^Ci 

J?. ^ 

-r- "O -C 

S ^« v_ 
- LL 5 

CO ^ at.- 



O CO 

O o> 



CD 



O 



a cl 



(D 
O 
C 
0) 

cr 
<u 
CO 

E 

I. 

o> 
o 



0. 



IS m 



= i 



o 



o 
.J 



x: 



LL LL 



00 o ± 

CD ro G) 

f L 



o 

"Is" 

O CO 

O > 

CO c 

c: <o G) 

0) 0.) > 
O C) 0 

^ o CO 
o> ^ 
C/j .E 



E 
o 



o: 

LL 



CO 



E 




o 



o 

CO 



o 
o 



o 



— 
o 



CL 



JOGJJOQ JUOOJed 



259 



Vil^. 24: l^orcent: of inci-onse or decrease of correct resiionsas from prot:csL-S' 

t:o posLLciU-i; on noiii)ror;raniniccl sLlmuli for cxpcr i.nienL^il cind conttrol. rAibjcicLs. 
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Fig. 25: Tol:aI cy.po7; l;:ienr.al hist:ory (nine complex relational positions across 
four tents v/ith intervening programs) for Subject J. 
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ProcTGss Report: Studies of Inctructional Methods and Techniques 

.in Remedial .Reading 

: By • 

V/olf and Christopherscn 

During the present grant year, the research sponsored by 
the Fational Lab has included several areas of emphasis. These 
^include: 1) the development of a supervisory package for mon- 
itoring paraprofessional tutors, 2) the evaluation of a new and 
different set of tutoring materitils, 3) an article describing 
the Juniper Gardens reading program, M-) an article reviewing the 
use of paraprofessionals to tutor reading, and 5) an unpublished 
doctoral dissertation conducted at the Juniper Gardens reading 
program . 

I. ounorvisory Package 

Barnard, Christophers en, and V/olf (1972a, 1972b) described ' 
the effects of introducing performance related feedback to the 
v.'ork behayior,..4>'f- paraprofessional reading tutors, in an attempt- - 
^t,a, maintain these on-the-job performances in the paraprofessional 
staff. Pive paraprofessional tutors served as subjects. Three 
distinct classes of /.or behavior v;ere examined: l) complete- 
ness of tutoring, £'.) accuracy of data sheet calculations, and 
3) the time tutoring began each day. A multiple baseline design 
v;as employed in which the feedback package was sequentially in- 
troducdd to --dependent variable? in a time-series fashion. Changes 
in the levels of the treated variables were assessed relative to 
their own baselines, and relative to the concurrent baselines of 
the untreated variables. 
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Each day one tutor v/as randomly selected and a tape record- 
ing of one of his tutorinc sessions v/as scored by the experimenter 
for corapletenecs of tutoring. Also checked v:ere accuracy of the 
tutor's data sheet calculations for that student and the time the 
first tutorial session was begun. These results were publicly 
posted on a feedback display board in the reading lab and in ad- 
dition, were introduced to the employees personnel folder* The 
* ... 

display scoreboard showed the tutor's name, the date,, the per- 
centage of student's answers to comprehensive questions correctly 
tutored, whether the tutor computations of that student's data 
sheet were found to be v/ith or without errors, and finally, the 
actual time at which the selected tutor's first tutorial session 
was begun. 

Analysis of the conditions showed that the mean percent 
v/ith vrhich student's ansv/ers were completely tutored increased 
from a baseline mean of 42 percent to a treatment (or feedback) 
mean of 93 percent. The percent of errorless data sheets shift- 
ed upv/ard from a baseline mean of 62 percent to a feedback mean 
of 75 percent. The time tutoring began remained unchanged. 

Five t-tests were performed to assess the probability with ' 
v/hich the observed differences in condition means could be attri- 
buted to chance variation. Data were treated as correlated and 
observations were paired (Dixon and Massey, 1957) . Three of these 
t-tests compared the final eight days of baseline with the first 
eight days of feedback for each variable* Resultant t-scores 
shov/ed the condition mean difference to be significant at the 
.001 level for variable one; significant at the .01 level for 
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variable two; and significant at the .05 level for variable 
throe. Two additional t-tests analyzed the natural variation- 
in the final 1G days of basseline for variables two and three, 
thus servinc as controlc for chances occurring in variables 
one and two. Neither of these t-scores were found to be sign- 
ificant at the .05 level. 

These results suggest that the supervisory program was 
functional in increasing and maintaining two of the three ob- 
jectively defined tutor work performances to which it was in- 
troduced. The complete details of this study are included in 
Appendix A. . ' 

2. Tutoring Ilatei-ials 

Another study (C-untert, 1972) conducted during the present 
grant year involved an analysis of the effects of a new remedial 
reading series published by Sarnell-Loft, Ltd. called the Spec - 
ific Skills Series . V/ith this series, seven separate reading 
skills can reportedly be tutored. The skills chosen for this 
project v/ere 'Tollov/ing Directions", "Locating the Answer" and 
"Using the Context". Paraprof essional reading tutors were used 
in this study to accomplish the tutoring. The tutors utilized 
previously developed reinforcement contingencies to maintain 
sentence and answer accuracy, 

The evaluation was designed such that the final reading unit 
from each specific skill composed the test for that skill. In 
this wa^/, it was possible to tect each student's performance in 
a particular skill before and after tutoring on that skill. In 
addition to these embedded tests for specific skills, a battery ' 



of standardised achievement tests v/ere adminiBtered before and 
after the tutoring. 

The complete description of the procedures and results are 
included in Appendix E. Generally, the standardized achieve- 
men'*: test results indicated that using these materials produced 
results superior to those obtained v/ith the SRA materials uti- 
lised in the Reading Program since its inception. The Barnell- 
Loft series did improve the students' performance v;hen each 
specific skills v/as tutored, however, an additional control 
group using different tutoring materials coupled v/ith the Spec- 
ific skills tests v/ould be necessary to fully assess the reading 
improvement. An important conclusion that can be drav/n from 
these results is that the present tutoring program, as developed 
over the past five years under CEMREL support, is sufficiently 
v/ell developed to provide a standard for examining tutoring 
materials. 

3» Juniper Gardens Reading Program 

An article (Christophers en, Davis and \7olf, 1972) published 
in Kansas Reading Quarterly ^ contains a brief discussion of the 
tutoring program and the results, obtained at the reading lab of 
the Juniper .Gardens Children's Proj'ect. 

A tutoring procedure has been developed v/hich uses commer- 
cially available reading materials (SRA Reading Lab Series Ila). ■ 
The procedure involved instructing the student to read aloud, and 
subsequently providing differential consequences for the students 
oral reading accuracy and question ansv/ering accuracy. 
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ThiG proG-rani rclion on paraproToGcional tutors to inpleraent 
the remedial procedures. Those tutors have been either house- 
wives or hiQ-h school students from the area. \!e have found they 
not only made good tutors, but aided in keeping program costs at 
a minimum. 

After less than 15 hours of tutoring, the tutored children 
^showed a moan cain of 1.5^ school years on the accuracy componant 
'of the Gilraore Oral Reading Test. The nontutored students gained 
a me.--.; of .3 school years. In the comprehension section of the 
same test the tutored subjects gained a mean of .75 school years 
compared to the non-tutored mean gain of .3 school years. 

On the Metropolitan Reading Test, the tutored subjects shov;- 
ed a mean gain of .01 years in Word Knowledge and .5 school years 
in Reading. The nontutored subjects shov/ed a gain of .03 years 
and .2 years respectively. 

For more details of this study, refer to Appendix C. 

^« Far atjr o f e s s i on a 1 s Tijtoring Reading 

■ 1 

In Lutheran Education a similar article is in press 
(Coristophersen, English, Fischer, Galecki, Larkin and Davis, 
1972). The project described in this article was conducted at 
a parochial school in Kansas City, Kansas. Again, paraprofessional 
tutors were responsible for the remediation, using the same pro- 
cedures of instructing the students to read aloud, and providing 
programmed consequences for oral reading accuracy and question 
answering perf oimance. 

One variable in this study was manipulated—a different set 
of comraericially available reading materials was used (SRA 
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Comprehoncive Reudinc ^Series). Results obtained in this study 
differed from those of the previously mentioned study 
(Christophorbcn, Davis and Wolf, 1972) in that after tutoring 
Avas completed^ the tutored students showed a mean gain of 1c? 
school years in oral reading accuracy and 1^5 school years in , 
coDprehension (Gilmore Oral Reading Test)* The nontutored sub- 
^ Jects gained .5 years and lost 1.2 years on the same components, 
respectively. On the Metropolitan Reading Test, the tutored 
subjects gained a mean of 1.2 school years in Word Knowledge 
and .9 years in Reading. The nontutored students made no change 
in V/ord Knowledge and gained .5 years in Reading* For more de- 
tails of this study refer to Appendix D. 

5. Unpublished Dissertation 

■ Davis (1972) in an unpublished dissertation, used three 
sets of relatively similar materials and investigated two read- 
ing behaviors v;hile tutoring seven children v;ho had reading de- 
ficits. The tutoring procedures were very similar to those 
previously developed at the Juniper Gardens Childrens ' Project 
(Christophersen, Davis and Wolf, 1971). 

In order to assess the dependency of oral reading on ques- 
tion ansv:ering accuracy, the ort^erimenter conducted four .experi- 
ments • Different variables were examined within each experiment* 
In E:cperiment 1, both ansv/ers and oral reading were scored for 
accuracy, and the child v/as instructed to correct any mistakes* 
Little co?,'^relation was found between accurate oral reading and 
ansv/er ac curacy ♦ 
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In E>q?criment 2, only the ancv/ers v;cre scored for accuracy 
and the child v;as instructed to correct any v/rong ansv/ers. ..In 
this case, the rate of correct ansv;crs increased. 

In Eiqperiment 3 9 contincencies v;ere placed only on the 
child's oral reading. That is, reading accuracy was recorded, 
and reading errors v;ere corrected. In this experiment, the per- 
cent of correct ansv/ers decreased. 

In E>;^eriment 4, a multiple baseline design v;as employed 
for each student aci^oss the tv;o behaviors: ansv/ering questions 
and oral reading. Each student began by readii^jj and answering 
questions aloud: no corrections were prompted by the tutor. 
After several baseline sessions on oral reading, the tutoring 
procedures were introduced. Similarly after a pre-^determined 
number of sessions, ansv/ering questions v;as then tutored. 

In E:q)eriment 4, the oral reading accuracy increased from 
a baseline mean of 74 percent to a tutored mean of 82 percent. 
Ansv/er accurac^y increased from a baseline mean of 52 percent to 
a tutored mean of 59 percent. The results of Experiment 4 clear 
ly support the view of oral reading and question-ansv/ering as 
distinct behaviors. Tutoring oral reading did not effect accu- 
racy of answering; only direct tutoring of answering increased 
•^'he accuracy of answering. 

The results obtained in this dissertation suggested that 
oral reading and answering accuracy are independent. This has 
clear implications for futher research. Tutoring programs might 
profitably concentrate on tutoring only specific goal behaviors^ 
Certainly, the research presented here has supported the use of 
an empirical behavioral approach to field of remedial reading. 
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Introduction 

Many applied proG3:'ams are tending tov;ard increased utilization 
of paraprofessionals (Staats 1970; Ellson 1971) • Despite the advan- 
tages of increased availability and lesser salaries, the problem of;, 
maintaining adequate on-the-job performance with paraprofessionals 
has been reported (Pierce 1971)* In this study of a community recre- 
ation center, the satisfactory v/crk performance of paraprofessionals 
was maintained only under conditions in which pay was. contingent upo.i 
completion of individual oob-components. 

Gibbs and Brov.Ti (1955) » demonstrated Vhe performance of v/orkers 
operating a document copying machine to be signifigantly increased 
when feedback on the number of documents copied was provided. In an. 
institutional setting, Paiiyon, Boozer and Korris (l970) reported im- 
proved performajices of paraprof essional aids to retarded children, v/j 
t;he introduction of feedback on the number of therapeutic sessions 
conducted. Leitenberg, Agras and Thompson (1958) reported desired . 
changes in the behavior of patients treated with a technique incorpo- 
rating feedback components. Several recent studies in educational 
settings have pointed to the importance of feedback in establishing 
and maintaining appropriate teacher behavior (Thomas ; Cossairt 
Thompson, Kolmberg and Baer, 1971)* Finally, in an industrial settin 
Feeney (1971) reports much improved job performance, along with consi 
erable reduction in company expenditures, upon initiating a system to 
provide v/orkers with knov/ledge of their daily performance. * A compre- 
hensive reviev/ of studies dealing v/ith the effects of feedback on' 
human behavior is provided by Annette (1969)* , ' ' ' 



Tho i')rGGent study investieatod the effecto of perforniance- 
related feedback on the behavior of paraprof escional reading 
tutors. . ' * 

KETHOD • * *■ 

Pacility: . ' * 

A remedial reading prograni served as the setting. The facil- 
ity housed five small rooms for tutoring, each equipped v;ith a 
desk; chair; a remotely operated add-subtract point counter; a • 
■ cassette tape recorder, and stop v/atch* Tutoring rooms v;ere linked 
to a master intercom system* ^ " * • 

Subjects: 

Five paraprof essional reading tutors served as the subjoctts.. 
Of t^vo adult v/omen, one had completed the sixth grade^ and the othe 
one had earned her GED Equivalency diploma. Both had been employed 
for approximately a year and a half. 

Three additional subjects, v/ere high school students, employed 
through the Neighborhood Youth Corps. Shese teenagers worked 2 
hours per day and had been employed 7 months prior to' tne study's 
outset o 

Daily Routine: 

Tutoring sessions occurred each v/eek-day after school-. Readin 
materials v/ere modified from commerically available SUA reading lab 

Vrnile students read stories aloud and ansv/ered questions over- 
the materials, tutors monitored their performance, " awarding and <s\xo^ 

tracting points.. ' . • . 
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Tlu-^oo distinct claoses of tutor behavior v/ere examined* Thej 
were 1) coniplctncss of tutorinc, 2) accuracy of data sheet tabu- 
lations, and p.) the 'airae tutoring v.^ac begun each day* 

Por complete tutoring, tutors had been trained, and v/ere in- 
structed to emit a short verbal praise statement follov/ing each 
correct answer* A complete tutor after a studentn' correct ansv;ei 
was thus defined as any audible utterance emitted by the tutor 
following that correct answer. 

Following an incorrect answer, a complete tutor response v/as 
defined in terms .of 3 components. A tutor emitted verbalization w 
to occur, v/hich directed the student to refer back to the reading 
selection, and v/hich prompted the student to physically point-out, 
or read a question-related bit of information* For example, refer 
back prompts usually took the form of "turn .back to the story", 
"look up in the story" and so forth* Point out prompts, in contra, 
v/ere defined more specif io-.-xlly, calling for an observable physicsuL 
response such as "put your finger on sentence A iyoint-out v/as 

also said to have occurred whenever a student re-read a sentence 
al.oud. 

Recording of complete tutor behaviors v/as accomplished util- 
ising a standardized data sheet, scoring each of the response com- 
ponents in an occiorrence vs* non-occuirence, fashion. 

These data v/ere combined, and expressed in terras of a single- 
percent completD tutor measure. This measure was obtained by divi< 
ing the number of completely tutored imswers, by the total number ( 
answers given per session. 

Inter-observer reliability of this response measure was assessi 
by having both trained and naive checkers independently analyze the 



cxistinG audio-tapes of roadrnc sesoions* Periodically, each of 
2 regular obsorverf3 would encore the same student's tapo^ Infre- 
quent naive checker assessments v;ere made, by givinc visitors a 
set of vnrittcn instruction^^ and the materials for making the check 
Naive 0 records were later compared to those of regiO^ar checkers a 
Reliability of -occurrence v/as assessed throughout, and v;as obtaine 
by adding agreements between checkers on response occurrence, ques- 
tion by question v/ithin each response component column^ An over- 
all percent measure of occurrence agreement was then obtained by 
adding the total number of agreements and dividing by the number o 
agreements plus disagreements ♦ 

II Accuracy of Calculations 

Part of each tutor's job entailed tabulating the daily writte 
records of the student's oral reading and question anaswering per- 
form.ance« The accuracy with which these computations v/ere made, w 
selected as the second dependent variable* 

Two products were thus obtained: the students' percent answe 
accuracy and his percent oral reading accuracy* In order to obtai 
the students percent ansv;er accuracy the tutor was to count the . 
number of correct ansv/ers^ divide by the total number of questions 
ansv/ered; round off, and record the resultant on the data sheet. 
An identical sequence of operations v/as required in computing per- 
cent oral reading accuracy. 

Each day, regular checkers retabulated all data sheets, scori 
the existing tutor calculations as being with or without errors, 
be scored as an errorless sheet each operation had to be correct. 
Any single error was sufficient to score the sheet as having error 
A standardized re-check sheet was used*- 
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The percent of erroi-^loGO data sheets served as the second dailj 
perfornanco moasure^ ociDressing the nujnber of sheets classed as v/iti 
out error, relative to the total number of data sheets on a given d£ 
Reliability of the measure v;as assessed by having a second checker 
independently analyze and raailc a day's data sheets* Agreement bet- 
v;een checkers was defined as occurring v/hen checkers ranked a sheet 
similarly. a?he reliability index v/as obtained by dividing the no. c 
agreements on scoring by the number of agreements plus disagreementc 
Kaive checkers provided additional, but infrequent checks of reli- 
ability • 

III Time Begin Tutor: 

The final variable chosen for analysis v;as the time each tutor 
began tutoring his first student on a given afternoon. Under normaH 
conC iions, daily sessions v;ere to have begun promptly at 3:30 p.m. 

The beginning of a reading session v;as readily identifiable, as 
t:.cu6.ents f^lv^ays recited descriptive information aloud, such as name, 
Gate, session vvomber etc., prior to reading their first story selec- 
tion. .A session's beginning v/as defined as the time at which the 
student began reciting that information. 

Because each tutoring room was connected to a master-intercom 
system, observers had unobtrusive access to this response when it 
occurred. Regialar observers listened fory and recorded start tines 
a standard data sheet. Digital clocks served as the means by v/hich 
time of day was measured. • * 

Inter observer agreement v/as obtained by having a second observ 
independently record the same responses and time of occurrence. Ob- 
servations within one, minute of each other v/ere required before agre 
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n:or.t v;as credited with occu-ronce. a?::o r;u::bGi- of aGi-eomor.ts on 
tirne-bei-ir-, divided by the nu.vber of aGi-eenients plus disacrecmentc 
served as the index of reliability. 

Fro::, those records the r.ean time that all tutors bocan tuto: 



in~ v;as coir.puted. 



Design.: 

A r.ultiple baseline desicgn v;as eir.ployed in v.'hich each of the 
dependent variables v.-as analysed concurrently across all subjects. 
Co::ipound independent variables v.'ere introduced to each dependent 
variabD.e in a ti:.ie-series fashion. ChoXiQes in the levels of the 
treated variable v.-ere assessed relative to its ov/n baseline, a:ad 
relative to the concurrent baseline of the untreated variables. 

Baseline data •..■ore collected over 21 workinj days. Luring th 
tine, tutoring occurred unchanged as it had for roughly -IS r::onths. 
Each day one randomly chosen tape per tutor v;as analysed in ter.7is 
corapjete tutor. All da'c^a sheets v;ere checked for accuracy of calc 
ations, and the session start tines v/ere recorded. Feedbaclc on pe 
foraance on each of these measva-es v;as v/ithheld fern tutors during 
baseline. 

After 21 days of baseline, a fornial neeting. of all reading 
-rograrr. personnel was held to introduce feedback for complete tuto 
ing. V/rit-jen hand-outs wore distributed, centioning both the lift 
of national •.•■•age price controls and the need for objective perfor" 
:r.easures by v;hich tutors could i-e uated for pay raises. The c 
cision to select the complete tutor perf orn^.anco r.easure \wp announ 

Written definitions of, and in-structions for completely tutor 
foilovv'ing correct and incorrect ansv.'ors v/ere provided. As a suppl 
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mcnt, a 20 luinuto video tape v;aG vicv;ed, prooenting the moat fre- 
quently encountered question tJTpeo, along v/ith the appropriate 
models of complete tutor behavior for each. 

Daily performance v/as made public each day by means of a 2 ft 
X 5 ft feedback board, centrally displayed in the reading lab^ This 
"score board" shov/ed the randomly chosen tutor's name ^ his percent 
perf ormai"/CL- scores for each of the complete tutor components, arxd ir 
.addition contained a spot on which. the project directors daily sign- 
ature appeared* Tutor performance scores were also placed in the ]\ 
tutor's personal employee folder o . ' ^ 

Feedback Accuracy of Calculations: 

Baseline data v/ere collected on the calculation measure for 29 
days. On day 30, feedback v/as introduced to this variable. Tutors 
were again assembled as a group v/ith written handouts distributed 
and reviewed. The handout informed tutors that they would receive 
feedback on this performance through the feedback board.. Component 
operations of the calculation process were also reviewed for the 
tutors in the handout. 

In this second condition, then, the randomly selected tutor' not 
only received feedback on performance on complete tutor, but further, 
had posted v/hether that student's data sheet v/as. ranlced as being v/itl 
or v/ithout error. This information was also introduced into the 
tutor's personal employee folder. , * 

Feedback Time Begin Tutor: 

Feedback v/as introduced to the time . begin tutor variable on day 
38 by calling a third brief group meeting. The time begin tutor vari 
able v/as introduced as the final tutor performance measure to be. 
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monitored aiid poctcd on the rocdback boards Durinc this condition 
the randomly chosem tutor v/as given laiov/ledce of hio complete tutor • 
percent scores, v/hethcr or not his calculations were done properly, • 
and the actual time ho began tutoring his first student on the day • 
in question. \ 

RESULTS /J^D DISCUSSION 

Regular observers checked reliability of complete tutor on 20 
separate sessions v/ith a resultant mean percent agreement of 98. 
Kaive complete tutor checkers obtained a mean agreement score of 8^ 
percent. Reliability checks ok accuracy of calculations yieled ^97 
percent agreement bet\';een regular checkers and 89 percent h'^t^/een 
naive O's. Interobserver agreement on time begin tutor averaged 95 
percent. 

Figure 1 summarises the mean performance of %11 5 tutors on eacl 
of the 5 dependent variables measures over 53 session days. Analysis 
of the condition means shov/s that* the mean percent with v/hich stud- 
ent *s ansv;ers v/ere completely tutored increased from a baseline mean 
of #2 percent to a treatment mean of 92 percent. The percent error- 
less data sheets shifted , upward, although in a less pronounced fashic 
from- a baseline mean of 62 to a feedback mean of 76. The time begin 
tutor variable remained unchanged, vath mean time begin averaging 
p.m. during baseline, and 5 J ^2 p.m. under conditions of feedback. 

Tnese multiple baseline data suggest a functional relationship 
betv/een the introduction of the complex of treatment variables and th 
observed behavioral changes. V/hile it is tempting to attribute these 
changes to the feedback component alone, such a conclusion .would be.. 
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premature. One cannot point to tVio feedback diaplay board aa ha vine- 
been intecral in chancinc and maintainine performance, as the mention 
of performance contingent pay raisen, for example, may have played 
an equally important role* The only tenable conclusion v/ould be that 
this particular combintation of variables effected signifieant poaiti 
changes in two of the variables to which it v/as introduced* 

It is important to note that while tutors frequently contacted 
feedback on their performance via the feedback board, the confoundine 
components of the treatment packaG^ were contacted only once-at the 
manipulation meetings* Equally important, considerable effort v;as e:: 
tended to control for the supervisory variables common to most v/ork 
situations, during feedback conditions* a?hat is, tutors received no 
feedback on their performance other than what v/as posted on the feed- 
back board. 

raese findings add support to the conclusion of Panyon et. al.^ 
and Gibbs and Brovm, that feedback on performance is a powerful soiirc 
of behavior control. As v/itnessed in this study, and as suggested by 
Annette (1969), the nature of the dependent variable measure to. which 
it is applied, however, may determine both the magnitude and longevit; 
of its control. Important to consider is that the observed behaviora 
changes reported here were effected ver^^ practically* The amount of 
time required to randomly sample any one tutor, then rate and post 
his or her performance required only 30 minutes per day* The gains 
of treatment, however, v;ere signifigant to the e>rt;ent that the origins 
reading research undertaking could be continued with the assurrance 
.that the proceedur^es were be^ng reliably performed*' . . ' , . • 
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Roinedial Roadint^: A Pro^^nxin Conducted in an 
Hlcmentaiv School Utili/.in^i Paraprof ocGional Tutors 

Jane C. Guntcrt 
University of Kansas 

Introduction 

To dato, thoro have boon rolativoly How studios published pertaining 
to ron:odial reading that utilise objective data. Christophoreon, Cavis « . 
and V.blf (1970), Jnado a pilot study of an automated remedial reading 
program. Tiioy concluded that a »'contin£^ent aloud'* condition (the child 
read aloud and v;as reinforced for correct answers), produced accurate, 
le\->-rato responding. This study indicated thiat it was possible to 
exhibit oxpe rimontal control over local accuracy in a reading situation. 

Christopher sen, Davis and V/olf (1970) began a remediol reading program 
■utilizing paraprof ossional tutors and commercially availiable reading 
Katorisls (SiU Reading Lab), The students received points contingent 
upon the correct reading responses^ After an avera,ge of 1^ hours of 
tutoring, the experimental subjects gained a moan of 1,5^ years in oral 
reading accizracy and gained a mean of* ? ifionths in comprehension, on the 
Gilrore Oral Reading Tost (Gilmoro and Gilmore I968), The control group ■ 
gained a moan of 3 i^ionths in both areas. 

In another study, Cnristophorsen, Davis and Vfolf (1971) produced 
even more promising results. The same procedures were used in the stxidy 
although a different sot of materials (SRii Comprehensive Reading Series) 
vas used. Aftor approximately the same amount of remediation (1^ l^qurs), 
the tutored students gained a moan of 1,7 yoars in oral reading accuracy 
and 1.6 years in comprehension (Gilmore and Gilcox^Q, op, cit,) Txio non- 
tutored students gained a mean of 6 months in accuracy and receded a noan 
of 1,2 years in comprehension. 

In a latest study of Cnristophorsen, Davis and Vfolf (in press) the 
sotting was a par^ochial school in Kansas City> Kansas, and paraprofossional • 
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tutors txitorod disadvantacod children from tho aroa, Tno.readlnij , 
natorials wore tl;o SPuv Coiriprohonaivo Rcadinc Sorios a(jain; hoKovor, 
two c"<^^^P^ ^^"^'^•^ contrdnins tutored and non-tutored children v;oro exarrdnod. 
In this study tho tutored students in group 1 gained a moan ofv2.0 years 
in oral reading; accui^acy a:id a moan ox 3.3 yoars in coi^iprohension (Cilrnoro 
ct,al.) The non-tutorod studciits in group 1 gained nothing in accuracy 

and givinod a n;oan of 1,6 yoars in comprehension, In group 2, tho tutored 
students gained l.'r years in accuracy and 2,0 yoaa^s in comprehension, 
vhile their controls gained nothing in accua^acy and gained 9 months in 
comprehension, (Gilmore et,al,) 

The present study is essentially a replication of the one just cited, 
except that only one group was tutored, and the reading materials v;ere 
changed, 

Methods 

Setting 

Bight children wore chosen by the school principal for tutoring 
because he felt they were underachieving in school. Six of these children 
were fou:id to have reading abilities which were equal to or lower than 
their grade equivalent in school from the achievement tests administered 
to them at the start of the study. Three of those children were randomly 
selected to bo tutored; tho throe who were not tutored remained as controls. 
Mcitori^^ls v 

The reading materials used were tho Specific Skills Series by Barnell, 
Loft, Inc, Example l)*shows level "C" of "Follov/ing Directions*', Tho 
child Wu.s instructed to read tho directions and the questions. Example 2 
Sfiows level *'C'' of •'Locating tho Answer'*, Inoorder to show it on ono page,. 
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Univ No. 50 . • 

DIRECTIONS 

This tolls how to play Circle Ball. Make a big circle. One 
plr.yor -cts in the center. The other playcr.s try to hit hirn with 
.the ball. When the player in the center gets hit/he goes out. The 
player who threw the ball talccs his place in the center. He stays 
in until he is hit. The garnc g'oes on in this way. 



1. This tells how. to play — 

(A) Fast Ball 

(B) Circle Ball 
.(C) Wall Ball 



2. One player gets in the middle of the — ■ . 

(A) net 

(B) circle 

(C) W'affon 



3. The other players try to hit him v/ith a 

(A) stick 
(3) ball 
(C) penny 



4. If the one in the center is hit. he must ' •, 

(A) play football 
...» . " (B). ffo out 
: . • (C) get in the middle . 

« ' * * 

■ j^.ji uuKi uu I ll - I t I - l u i M iii u III I . ' I , ' " '' VV""'^vr-f" 
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Ur.it No. 25 ~ SHELTERS EVERYVv/rlERE 

(A) ShoUors in other counirios arc Oxton quite diuorcnt ironv 
tho siioitors in our own country. (B) The houses of xar-ofi: lands 
are so.n\etirnos niado oi strange materials. (C) Sometimes they 
are built in a different ^vay. (D) They may even bo -found in 
places where most of us would never think of living'. 



(E) In ihe cold North the Eskimos build their houses out 
of stone a:id earth. (F) In tlio winter when Eskimos go on 
hunting trips, they make another kind of house, (G) They make 
iz out of sncvA (H) It is called an igloo. (I) Snow is the only 
building material they have in the winter. 

(J) People who live in warm countries often make houses 
out of grass. (K) Grass houses are easy to make and comifortabie 
to live m. (L) Sometimes . .these grass houses are built on the 
i^round, (M) Sometimes thoy arc built in ti'co.s. 

Univ No. 25 - QUESTIONS ■ 

1. Ai-e sheltGrs in other countries different from ours? 
Senier.ee (A) (B) (C) * 

2. Who builds houses out. of stone and earth? 
Senience (C) (D) (E) 

3. "What is a house of snow called? 
Sentence (F) ' (G) (H) ..• , 

'Sentence (I) ' (J) ... (K) . . _ • . 

5. Crtn grass houses be buiit in trees? 

. . ; • ■ •EXAI'S'LE 2 



tho stoi'y fiocv.ion and Uio question pa^i^o v;oro cut in half. Sach stox^ 
had 10 qv.cstiono about it, 

E:>-^:Toio 3 shows level »'C»» of ••Ui^ins tho Conto>:t". Tho chilcu^on v;oro 
instructed to road all of tho sontoncos and thon tho word choicos boforo 
illlln^, in tho blanks. 

In addition ^ two ?ana:;onic portable cassotto tapo rocordors (rodel 
no. R'::-2C9 das) woro used, 

:Zc.cn 'ct'udcnt vras removed from his class and taken to a previously 
dcii^natcd roo;-a in the school which was equipped for tho tutoring sessions 
Tno child sat in a dosk-chair ^.dth tha tutor noj^tt to him, Tho tutor 
rcr.otely operated a coui-itor which was visible to tho child, to cither 
add or subtract points ^ Tno student was instructed to x-oad all of tho 
p^ritorial (stories and questions) aloud. In this case, throe skills (or 
workbooks) wore hoing tutored. They wore: Following Directions, Locating 
tho Answor and Using tho Context, 

V.non tho child read a sentence, question, or answer, he was awarded 
one point, FoUovd-ng each error tho child lost three points, and was 
instructed to correct the nastake. This correction* could be iii the forin 
of correctly pronouncing a w^ord or sentence, or finding the right 
ar.sv;or. After tho student had corrected his mistake, he was awarded one 
point and praised by the tutor, Com.T.on examples of tutor praise arot 
••That correct", "That's right" and "That's very good,"' Tno definition 
of or. . -.ading errors follower Cilmoro and Gilmore (19^2) except that 
hesitations were not couiitod as errors, Tnat is, mispronounciations, 
repotitioiiS and oiiii::;sions ox v;ords would bo considered as errors. 
Hesitations v:oro not, in an effort to encourage tho sounding out of words. 



Uni^' No. 25 



Pish und the Gtrangos': pk.cos to hide. One small fish sv.'irni! 

rir;h: ir.w his r.\otl;or'a mouth! Out he (1) ■ NS'hGn tho 

danj^-or has (2) 

1. (a) cooks (b) riuii's (c) comes (d) rends 

2, (a) pnsscd (b) take (c) loys' (d) step 



A cat will oiton find its way home from a great distance. 

One cat traveled two hundred miles to cornc (3) to its 

owner. Cats have a good sense oi (4) 



S. (a) soad 
4. (a) rain 



(b) write (c) back ^ (d) av/ay 

(b) sat (c) direction (d) money 



Toy soldiers have been the playtliings of children for many 

yeai-i, Long-, long a^'o toy soldiers were (5) in amor just 

like :he (G) soldiers of that time. 



5. (a) let 

6. (a) reai 



(b) dressed 
(b) cat 



(c) side (d) last 

(c) cookie (d) hungry 



Did you know that your name means something? Alice 
means ''truth/' Peter means "a rock/' and Charles means "strong/' 
Find cu: what your (7) means. Ask your (8) 

?• (a) house (b) toy (c) look name 

(a) pet • (b) wagon (c) teacher (d) cow 



An ant can lift things fifty tiiiaes its own weight. If you 
could lift something fifty times your v.^eight, you could lift a Qar. 
The ant may be (9) , but he is very (10) • 



10. (a) lost 



(b) fat 
(b) snow 



(c) fast (d) small 

(c) strong ' (d) hide 



Or.e'., 

to (12) 

11' (a) dr- 

12. (.1) Tit^ 

It won'; i,-, 
(13) ... , 

13. (.1) ru: 
1*1. (a) 

(lo) . 

15. .(n) 

16. (.V-;. 



if YOil . ; 

It will \< 

17. (ri) 

18. (.1) li.:..- 



•not ;)!:iv i* 
(20) 

10. (a) si""" 
20. (a) ix'iv 
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;sh:llo tho tutor v:ar. lir^toivint', to tho cl-iild road cirxUvi*Jrdinc or 
ponra.ii:inc points r>ho v:af5 alt.o mking a poriinnont record of tho child's 
roadin-:. That is, on a apocific form, cho ir.arkcd whothor oach sontonco 
vrss i-orsd correctly or incorroctly. Taic shoot was ucod later to computo 
tho child' r, contonco accuivt.cy for tho day. (Seo Exaniplo 4) 

rno child vas £;ivon an anGv:or j>hoot at tho start of oach sossion. 
T:^o acciuv.oy of his \vTitten aniiV;orG was also conputod. (Soo Exarr.plo 5) 
This and tho sontonco shoot voro then placed in tho child's foldor, If 
tho child avoraced atloast 83w accm^acy for throo consecutive days, ho 
vas advanced to 'C.^o no:ct lovol in difficulty in tho workbooks. This was 
based on t)io assu^iption that if 'cho child rr.aintainod a high percent 
(above S3;..') of answer accuracy, ho could bo considered co2iipot.ont 
in tiiat iovol and ready to move on to a more difficult lovol. Once a 
week tho supor\''isor chaa^ted tho data on a graph as a moasuro of the child' 
prot;ress, 

Each cay "thio r.tvdont was tutored for approximately 20 minutes. 
Iv.u::caiately after the tutoring the child could exchange his points for ' 
r.oney. The rate of points to pennies varied \>dth oach slcill depending 
upon tho level of difficulty, For example, during tlie tutoring of 
"FoUovdng Directions'', all tho childa-^cn were able to road more (8-10 page 
thar. thoy could d^uring ''LocatinG the Answer" . (1-ii pages). In order to 
keep tho chdld's earnings consistant through the study, it was. necessary 
to change tho ratio of points to penraos. During "Following Directions" 
tho ratio v;as ^ points/penny, During tho remaining two workbooks the 
ratio was 3 points/pemiy. On tho average, the children o-i-cd between 
twenty and fifty cents daily. * * • 
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L^Uiviont \:aii tUtoroU for 27^?^) f-oi.i*:^,orii^\ thiu Ar.oiUitocI to 10 
hou:\; or I'cnoclivVtioni Sinco tlu")ro voro Uu*oo boin(; tutoroci^ v/o 

tvitorod u-\o citudonL Tor uv^pvo:cimatoly 9 Cioiilorij on ouch ciklU, 

Bcifoi'o c.ny ror.odia-'oion w.^.s bo^'AUi, oach titudont wao c^^^^^ battery 
of tojt;:. Tiio tOiJCG conjjijtod of; tho C:tliiVrnia Ar;lAicvor*ont Toct (Torn V/), 
tl:o Gil.r.oro Oral Koadinn To^st (foiu C), find a toat tho oxi^oriicontor coriv- 
poiicd fro;-: tho v:orkbookG, Sinco thoro wore tiix D.ovols in or^ch of tho throe 
vovkboo\<2f vo choGo ono vuiit {\i^-r7) froM occh lovol of tho throo vorrcbooks 
for z:\o p'rc-toct, Tho scores from thcco tosjts wore then avor^cod for each 
group, A co.v.psorison of tho tutored and non-tvitored c^o^ps could bo made 
to asi,ojs tho i jr.pr ovoiNont of each, Tne scores from thoso skills tests 
also dovcr;ninod tho level of difficulty that tho child would bogin in ^ho 
noyct tutcrin[i skill. For oxaraplo^ if Lhe child scored 100, 100, 100, 75, 
75, on 'cho tost levels A-F respectively, ho v;ould bo started on lovol 

Ai'ter "Following Directions was complotod, all six students v/ero 
givor. another skills tost-- this tost v/as composed of all units 
Af'ccr "locating the Answer" was corriploted, all six students v;oro given 
a si-ills "cest coruoosod of all units v!''r9. 

Alter "Using the Centocc" was completed, all six students wore given 
a skills tost composed of oH tho last units (ir50) in addition to tho 
Calif orr^ia Achievement Test (form X) and the Gilmore Oral Reading Tost 
(form 3), The differences in thoso scores detornined how much tho childN!en 
in each o*^^? i^*?revod, and which group made tho most significant changes. 
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Rosxiltc 

Thoro voro 22 reliability checks done on intorobsex^Gr rcliabiliuy. 
Tr.o pox^ccntacc of vit;ro.o:7:ont ranged botwocn OO and iOO^o vdoh a moaii of 
9v;o. Tho tutor c povforr.od the chocks daily after tho tutoririg was co:.ipletod, 
7:10 c:iocki> consisted of listoninc to tho tape, aiid scoring tho sontonco 
accur .:cy of 'tlio child as if tho listener Vvore the tutor. That is, if the 
listc:-or -ihou-ht tho sontonco vras read correctly, it wo\iLd be scored as 
correct or. a scpai^atc sentence accuracy shoot regardless of how tlio tutor 
reacted to tl-io sontonco. The reliabilities consisted of scoring orily the 
tl-io sentences that the chiild read; no ansvvors were included. Appro>d.r.at6ly 
3S-;$ of the sessions wore chosen for reliability chocks. Reliability was 
computed by diA'^din;^ the number of agsroen:ents by the nomber of agrso- 
r.ents pluji disagroorr.s;ntc and inultipljring by IQO, 

Tho first subject, rlike, vras in the fourth grade. He was believed 
to CO undorachioving in class; however, his pro-test achieve^ient test scores 
wore very good. He tested at grade level ^.2 on both coiiiponants of the 
Gilr.oro Oral Heading Test and at 6.0 yaai^s on "the " Total'* score of the 
California Achiever^ent Test. According to the data presented in Figure 1, 
r-ike' s 'r^^ accuracy was Under each workbook, 

the r.ean percent of answer ^acc^xcucy was s .-ijBS^S for Follovdng Directions, 
6^<j fo-r Locating the Answer and 82>^ for Using the Context. Aceording to 
tr.'^ data presented in Figm-o 2, riike's rr:ean percent of overall sontonco 
acc*ai*acy was 93/^. His sentence accuracy in tho workbooks was: for 
Following Directions, 8^ for Locating tho Answer and 97i^ for Using tho 
Conto^co. 

Tho second subject, Barbara, was in tiao eighth grade. She was soloctod 
for "che progra;^ because her roading abilities were so poorj on a pre-teso 
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c.r tV.o Gilr.-.oro Orci Koncdni: Tect, she scored a cr/ido oquivc'u.oncy' of 
2.9 yocvi'i on accua\icy and 3.8 yoai^a on coy.pi'Oiioncion. 

Bai'boi'a h^d tho hi[:host J^nsvror acciu-acy of tho c-o^P. ^^^^"^"^ ^ 
of 90 o. According to Fic^uro 1, on tho individual workbooks sho naintaincd 
a hi^;i level of ajisvci' accoi-acy vrit'n;.a Koan of 8?/^. for Follovrinc Edrcctions, 
93.0 for Locating tho Answer and 9i^v for Using tho Context. Accordine to 

2, her ir.can percent of sentence accui-acy vas for Following 
Diiv.ction^, 92;^ for Locating tho Ansv/er and 9^ ^or Using the Context. 
5ai*cai'a '-aintainod an overall Koan of for sentence accuracy, 

rne last subject v;as Randy, a fifth grade boy. Ke had boon enrolled 
in a sirilar reading program dui-ing the previous suiranor, but had a very 
poor attendance record. Kl -p. the experimenter had a li'ctle difficulty 
in getting .'landy to ooroe for tho tutoring, his ^attdndanco dui^ing ti-.is 
study vras flavjless, 

Figui-e 1 i;..::.catos "chat "Randy' s answer accuracy had a Kean percent 
of o?;-j. Under the separate workbooks, his ansvrer accui'acy for Follovdng 
Directions, Locating the Answer and Using the Contex^v had a nean percent 
of 90;4, 8?^o, and 82^;^ respectively. FlgoxQ 2 represents Randy's rceans of 
sentence accuracy, which were 9!^, 9<^ and respectively. Randy's 
overall r.can of sentence accm'acy was 915^. 

All three children maintained a high level of accuracy on ansvrors . 
ar.d sentences. On particular tutoring sessions tlie acdoracy may have 
fallen, but in only one instance was a child's mean percent of accuracy 

';• A comparison of tho sldlls tests scores -between the tutored and 
non-tutored subjects is shov.-n in Table I, Tho tost scores in boxes 
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Bisori:. Tablo I hero 

ai-o those tost scores ^-hich shovr any incroaso in the scores of the 
tutored subjects aftoi- t:.torin£ on that particular workbook had ceased. 
After tutorin- on Follo^a.nc Directions vras corapletcd, ^cho tutored j-roup 
had a r.car. score "chat was 18 points higher than the control E^oup. After 
Lecatir.3 -chc Answer was finis;ie4 ,tho exi>oriKiontal group tested an average 
of 13 points above tlxo control (-roup. I'Unally, after tutorin- Using 
tlio Ccntox, the tutored subjects' scores averaged 1? points higher than 
than the controls. These scores are focused on in Table II, below. 



xnsort Table Ix here 
As Tablo III indicates, the tutored subjects improved 2.8 years 



Insert Table HI here 

over -choir controls on tho accuracy coi.iponroat of the Gilrcore Oral Heading.. 
Tost. Loss significant are the comparisons of the California Achievessnt 
Tost scores, V.hilo the oxporiraental subjects made no noticeable changes, 
the control subjects' scores also remained somevjhat constant on the "Total 
score. Tho T-test, a test for the statistical slgnificanco of the results 
proved thcr.i to bo "not significant". ' ' ' . 

Ldscussion 

Ir. cor'-pai^ison vath the res-alts jaoldod fron previous studies, the 
t^resent research indicates an increase of atloast one year over any of 
the previous research (Chrictophorson, ot.al., 1970, 1970, 1971). ?ir.- 
poir/oing v.hy tho gains woro so much higher is difficult. There arc mny 
••.-.-r uc-ccs wo VJiV i-ulo out, but there is still no definite answer. Cio 
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Table i 



Moan Poi^cont Correct on Skills Tests 



ro-i^ovw* 
Liroctions 



Locate 
Answer 



Using 
Context 



Kon-tutorod 

Follov; 
Directions 



Locate 
Answer 



Usinrr 
Context" 



Tosw J- 
Tcst IZ 

i, O i> V- ^ I 



08 



92 



7^ 

.79 



58 



61 



80 

58 
•8i 



88 



62 



76 
62 



53 
67 



51 



67 
62 

5^ 



erJc 
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Tablo II 

Co:r/oarls6n of 2-lcan Test Scores After' Specific Tutoring 
—•■■■'••'"*'•*■* T^itorod Kon-tutorod 

Follov; Directions 91 
Lccatir-g the ^^nswer • 58 
Using the Context 87 



63 
50 
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Table III 



Koan Gain in Years 
Pre- to Post-tesu Scores 



Tutorod Non-tutorod 

Cdixornia Achiovoment Tost 

Vocabulairy " + »i 

Co'-VDrohonsion - .3 - 



TOoOj 



- ,5 -{-,.06 



Gilr:ore 

Accuracy +3*^ + .6 

Cor.-orehonsion ' 4-lt5 
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pi'ocoduvoG exactly tho sa:r.o as in previous research. Tno 

sotvl:-.j v:as also tho sa-.o, and tlio tutors sccrr.cd to porforra equally v.-ull. • 
T-nis loaves two variables: tho reading,- Tutorials and tho subjects vo 
soloctod. -no o^y way to elir.dnato one or bo"^ of these variables vrould 
bo zo replicate the study usinr dilTcront subjects and tho sair.o ir.aterials. 

There ai-e also Tour other slcills in the .3arnorL, Loft series that 
v:o did no-c tutor. 7aoy are: Gottins the Facts, Working vri.th Souj-.ds, 
I>'a-.-l:-i: Cor-clusions a^id Gettinc tlie :^,ain Idea. Tnose sldOls, co:nbined 
v-lth se:v.a that wore tutored, or loft alone, could also produce interesting 
results. 

In -ti-.e skills tests given intermittently during tho tutoring, the 
tutored subjects scored significantly higher than their controls. Tnis 
verifies that tho tutoring had some effect on the learning of tho so sl-dllg. 

-Tr.c California Aehieverriont Test scores are slightly lower, though not 
sig-r.ificantly, than in previous research. Tno T-tests proved these 
gai-swere not significant. However, it is exceodin&Ly diffieult to got 
statistics! significance with only three subjects in each group. 

Tl'.ere are at least two variables which we could manipulate for further 
-osoaroh, in addition to those already mentioned. One is tho leng-ch- 
of oir.3 spor.t on each skill. Ten of fewer sessions equals approxisiately 
three hours of re.r.odiation. Considering tho results obtained after such 
a i'-oro period of ti:no, increasing the .nuraber?\so5sions per sk-ill could 
eor.ceivably have a profowid effect upon tho testing results. 

^.3 a plan for furhter research, I would suggest (a) keeping tho 
sa:-e sk-ills c^.d lengthening tho nur;iber of sessions per sk-dll to 20 sessions 
or ur.til the end of lovol"i-' is reached, and (b) changing' one s:<ill, for 
e>-".;.lo Using xho Context to Getting the 1-iain Idea or landing tlio "F^-Ots 
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K:\-iIo l:oopi:-.G -"-^ other cor.clitions cor.strint. r.y follovdnn cystoniatic 
roy_icatior::i (Sidiii^u, 1960) of tho study, it vrU2 b3 poscibie to fir.d 
;<hich cor.-.bin:^tions pi'oduco Uio r.ost ofroctivo ro:r/jdiation. 
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i*'ootnotc£ 



irom tho university Gencral 
12. R. Ch:^i:>tophcrGen» 

- .^ 3 nature r/ro iroosciiblo vrithout tho activo support 

of^ 30^001 prii^cipoli: like ?:ua vroltors, Lutheran Church oi Cur 
Savior School > KcnsaiJ City, Kansas, 

'-Vo rXt::or v:lGhes to thank Dtg, E.K.Chriotophorsen and V7olf 
iror ^:^cir G'^danco and Susan K, Tvaney for nor assistanco. 



rcoor.ro>. \;;\s Gupportod by a fj,rant 
rJo^or.rch l^md (35c6-6706), throu^jh Dr. 
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Koicroricos 



:Sc:idv;:.tr;ccd chUdi^cn. Presented at. Arr.erican Psycnole-xc^ 
.Association, Miai-ii, 19?0. 

:hri..o-o-.son. , D.vis. I-'.J., and V/olf.^H.K. ^.o Juniper Garden. 

rcIvdi.r.G presran. Unpublisliod I-'^uscripc, 

-V- -to-- c-sen E.R. , D.^vis, M.J. and Wei x", M.H. A tuteri-ns Pfogran 
^'""''SSr.in^S.a^'airofcssion.l tutors. Unpublished Manuscript. . 



Gil~.ore, J.V.. end Gilr-ore, K.C., Gnrjore Oral Ilead^ l^ew York: 

Hiu-court, Brace, Jovanovich, 19o3, 

SicLT^n :>urray. Tactics of scientific research, .New York, Basic Eooks 
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ParaprorcGcionalo (D-avorins Ilcaclir,c^ 

SdwcxTd S. Cr^istophorscn, Xathrj'n G. I>AC^licn» Kofchcrinc A. Fischer 
■ G\^j-nnc L. Galecki, Joan A. Larlcin, ar.d Kichacsl Jc Davia _ 

C?ho rcadins ability of elcr.cntary school childrcri is a 
topic of ^y^oo^t concern today. Researchers and educators are • 
conironted with a two-fold problem: structure early childhood 
education so as to caxiniize each child's reading skills and . : 
provide erfectivo remedial techniqubs Tor those children v;ho • 
have already acquired substantial reading deficits. We have . 
chosen to carry out research on this second alternative — 
re=iedial tecrj-.iques — and for our student population we have 
cone wO the Lui;heran Church of Our Savior School in Kansas City» 
Kansas . A central problem here — that of defining adequate ^ 
reading performance — has been vigorously approached by the 
reading achievei:ent test constructors. 2he assessnient of a 
given child's reading perforiiiance is usually dorxe v/ith these 
achieve;:ient tests. CDhe design of an effective rer*edial reading 
prograin niight profitably be directed at improving skills defined 
by the achievenient test as important. 

1\io skills which are comnion to the achievemont' test situation, 
to ^he classroom, and to a variety of tutorial situations are 
answering. multiple-choice' questions following paragraph reading 
materials and oral reading. A tutoring procedure has been de» 
veloped (Christophers en, Davis ar.d V/olf, 1970, 1971), using • 
commorcially available reading materials (SRA Comprehensive 
Ac-adin- Series), v/hich maintains the accuracy of;',an individual 
s-aden-;; ' 3 multiple-choice answers v/hile hp progre'sses through in- 



creasingly more difficult reading materials. 
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2ac:i ctudor.t is soatcd in a srnoll roo.ri in fron-e; of a desk 
•dpon v.'hich a counter is -.ountod. Cno tutor can rcrr.otely operate 
the co-on-cer to either add or subtract points. Student are re- 
quired to read all of the -materials (stories ar.d questions) alou.d. 
?ollo\vin2 each correctly read sentence, a point is added to the ^ 
student's counter. Pollov.'ing each error, three points are suo- 
trac-ced, the tutor indicates and corrects the error, and the- 
sfudono is instr-ucted to repeat the sentence. Definition of oral 
reading errors follov.-s Gil-iOre and Giln^ore (^968) except that • ^ 
hesi-cawions are not co'onted as errors. 

?ollov/ins "che correct reading of a question and axisv/ers the. 

studeno v;rit;es an answer. Pollov:ins each correct orisv/er, .a point 

is added to the co-onterj ajid the student is advanced to a nev/ . 
cuestion or story. Pollowins each incorrect ansv/er, tr^-ee points 
are subtracted, and the st-adent is instructed, to aiiswer the ques- . 

2ach day, each student is tutored for approxiiTiately 20 

utes, following -the ttitoring the student exchanges his points 

j . . 

for :;:oney at the rate of one cent for each points 

!' 

tutors i 
C?his prograa relies on paraprofessional tutors to do all of 
the reniedia^ion. 2hese -tutors have all been junior and, senior 
nursing students froa the University of Kansas Kedical Center. 
G:rainina the futors is an essential part of the prograsi. The tutors 
are first instr-ucted in the use of the materials and they are given^ 
practice in seating the student, preparing answer sheets, and check- 
■ -"-.3 ar.swers. (Dhoy are then, c^yon definitions of : the various types 
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.-ial roadina errors When they ur.derctar.d how to n^ark the re-' 
cord sheets; they practice tutorins in a role plains situation, 
v;i-.h a:i experienced tutor acting as a student, sbally, they ^ 
booin tutoring students under close supervision; ;>s they i:.prove, 
they are supervised rr.ore intermittently. So far'^; each new tutor__ . 
has been able to tutor correctly after ' only a fev^i hours of train- : 
ir.s "snd close supervision. a:hese tutors can 'use 'the procedures 
and r.aterials very effectively to -.aintain accurate oral readin- _ 
ar.d answering of questions by the student. An e:<tre:r.ely ir.portar.t 
aspect of this prosram was the inclusion of occasional reliability 
checks. Each tir.e that a student was tutored a tape recording was 
nade. A second tutor listened to the tape recorcing and recorded 
the accuracy of oral reading.' Agreement on the sccuracy of oral _ 
reading was then deterniined between the data froni the original 
.t-atoring and the data gathered froni the tape recording, to provide • 
•an indication oi^ the reliability of the tutoring.'; * : ■ 

♦ 
I 

Testing ! 
Since it is iuiportant that the reading iiriprovement be evident . 
outside the tutoring roor. as well, we also measured the students' " 
reading'with standardized reading achievement tests.. 

'. V/e adrainistered a battery of • tests prior to and following 12 
weeks of futoring. At the same times we tested non-tutored students 
Cur battery included the. Gilmore Oral Reading a?est and - the -Metro- 
poli-.ar. Reading 2est. As C?able shows, the' results were quite ^ 
-promising. ■ On all tests the tutored' students improved acre than' 
the nori-tutored stxidcnts^ «; * *' . ' 
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'All": 



Gilr.orc Oral 

Accuracy 
ComprohcnGion 



Metro^olitar^ 



V/ord Kr.ov/ledse 



Mca:i Gain in Years 
ProtoGt to Post tost 
fTutorod 



4. 1.7 . 



4- ^.2 
.4- .9 



Noiitutored 



V '.6 



+ .6 



Perhaps as iniportant as any cf our other results to date 
is our discovery that paraprofossionals , v/ith little training, 
can be erfcctive tutors. In a similar progran that.v/e are con- 
ducting in a iov/ incoiV.e area of Kansas City^ v/e are using high 
school students, in the Neighborhood Youth. Corps program, as 
Tvitors. 2he use of paraprof essionals as tutors provides an 
effective ziethod which is practical in terms .professional tiine 
and program exi^emso. • ' * ■ ■ 



erJc 
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i?oot;notc 



Gcarch v;as supported by crG.r.i:s xro7,i the National 

ioorclir.atinG Center, National Pro^ra^i on Early Childhood 
Education (02C-5-7-07070S-5''iie) a:id from the National 
Ins-i-cu^e for Child Health and Hur.an Developn^ent (H13 OJI^ 
and Public Health Service (NU-005'2). _ i . 
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■^ro-rar^s of this nature are irr.possible without the act-ve 
support of school principals like Yc:, Paul Walters, Lutherar. 
Church of Our Savior School, Kansas City, Kansas. . ,• 
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rvororoncoG 

^' r.-^ ' i>v-'-* ^^.J- and V/oir, ri.!'- c>--.oriTr.or.tal 
'*^^''^^^"rv:3is OX local accuracy aa. autor.atod roadins prosrazi .0-. 
diGadvar.taGcd children. Presentee a.. ;..e.xc<^. xo/c 
AsGociat;ion, >'is.rai, ^Sj70. ■ i 

• roldins prosra. usin, paraprofessional tutors. _ ^-^-^-"^^ ^ ' 
* t>rescn;:ation at; A..ericar. Psychological Assocxa.^cn, ^..on^.^.o.. 



D.C., Septeniber, '■|97'i- 



: if 



.':-:.ore', J.V. and Gili::ore, 2.C. ■ Gii^ore Oral Hoaaxns xes.. 
York: Harco-art, Brace World, Inc. 'i96S.;.| ' . 



CI 



318 

o 

ERIC 



a re:.iodi::-.i rcacinc pro:;r:aiM. 



Child:.iood ^Jducciitio:": 



IToveuber 



Dr-r-JTt. ITot :7o:? repi?oduc':;ior:, rof orencin:; or citcwio: 
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'Z-ic p.cr.iu :u'. is n con-plooe doccription o.r the i;oc'r;n.iouos 
and p::ocodu:.?os lor ectr;b?.::.3>.inr; ar.d v.:r.in-'>:a:lr.inG rorodir.l 
ro::;.dr;.r.f; rirorjrarn pc.-l-terr.od n.-Ttci" t;:.o Juniper Co.rdcnG P.endinc; 
rroji-cr. . Tbo procGdurcs '..•."re ox'i:;i:ially dovelopod in .1 
r,??ozrn:.: ir. 0. lov; incor.o rcderal houcinc; prooect (primarily 
blcclco), out have since boon, .roplicc.tcd c.t tho University of 
Kansas IX'dicc.l Contor, C'nildz-'on ' 3 ?.ebcu-;i3.i-bation Unit, and at 
tr:G Lut".-.c:;:an Church of Our Savior School in Kansas City, Kansas. 
Additional prcli:.-.inary v/orl: v/as conducted at Grant Elonentary 
ochool in Kansas Citv, Kansas. 

I-;anv ir.dividualG ha"v'G contributod to the development 0:? 
this i^anual includin:; Jccics J. Barnard, Jane Guntort, Ilary /oin 
KitcV.ell, Susan K. Sainey, and Caroljrn K. Voss. v;ithout their 
contributions this manual surely would never have been cor.plotod. 
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'2': 0 proc:!. s:-.oulr; bo c:::c::±oC out in a roll:: vol;/ 

r,uio\; ^rc-. LeoMBO 'I^ho i;-o:::rcun c±:.v. at inprovinc rcr.;:inc 
cxills, a--o:-. nucrb e.llcv; t-.c c'.riJ.d 'l;© co.xontr.-'-'Jo on v,-hc,\: 

•-.e is r.oinr;. Po.v thic ro;-.f;on it ±z neccss;:,:c',7 to scparixto t::e 
tutor :..,v.d child ;iro-.-.i obr.G:.: tutorin:.' couples. 

Soparutinc; fr.e tutori:-:.; coupler :r.r.y present a problo^i Por 
r.ccurato nupervisio- . It v/ould help c^re^tly to br.ve tho area ■. 
■ cruippod v.'itb a -onitorrnc: oyster-, such as an interco:- or one 
v;u7 :;.irr'o:,.'a . It is escontial t'nat fne supervisor be able to 
bear bov; the tutorin- ic bc-ir.;.: clone. T'ape recorders, ii avail- 
able, can also bo used. If none of tbece are possible, siipply 
keep tbc tucorinv' areas or rooms larpo enou-b for tbc supervisor 
■to be prosor.t durinp tbe tutoring sessions.. 

V.'it'-in tbe dcsicpated tutoring; ::.roa, a table and cbair 
sbouid bo provided ::or cbild and tutor. An cversirr.ed clipbocard 
j.arpo cnoupb to bold tbe readinp iMateria,]. on one side and papers 
(or.PL reading sbeets) on tbe otb.er side nay be used by tbe tuto::-. 
I;:" a ta-oo recorder is to bo used, electrical outlets and a place 
to set tbe recorder and r.icropbonc sbouid be near by. 

Pbo nuaber oP tutorinp areas or: rocc.s needed './ill depend 
on tl:c nu.nber oP tutors, l^acb tutor sbouid bave bis or bor ovrn 
are.-. A centrtvl worl: area, v/bere r.aterials can be kept, is also 
uscTul Tor dispersinc rein;::orce;;.;ents and as a v/ork area Tor tbe 
tutors vPien calculatinp pcrcentaees. If possible tbis roo;- sbouid 
be se:;ar.;:.te Pro:^ tbe tuterinp areas. _It is also advisable to 
bave a sr.iparate rocra v;borc cbildren v/aitinc: to be tutored v:ill not 
. disturb tlose v/bo are boinp tutored.. 
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Ci-co t::±s pi'o::;r; u dor/'s v;:Lth i:.-.::-:H;vin- the t\;o cicills, 
o"';,„"! ro';dini: nnd co;:p:.?o::c;r.r;:.or. (i.o. r;uo:.:-::ion ;;in c i n.;;) , .^"y 
v:: o:.-ialn ur.ed ;r.uci; ir.cludo; "i) ^xtoiri^a (£;to-iG«) thct c bo 
roc.d alou«l ;;-.nd 2) o/jcr/Mcr.::-'. coneerr.in; • r.cterirJ . Gtr.r.dr.i-a- 
i^^Gd rc-di-L:; rf:atG;cialr; 3uc> as tho 3:h'. madinc; 1-b kits ciro 
oc-a::,pG the: ccioio^t to u3£ in that ruootio:-G r:rA nnsv;e::'S a:ce 
supr.liod. r.ultiplG ohoice questions arc pj/of erj.-ed due to the 
casci cf i:::':;.dir.G thin t.ypo of cxisy:c::z. Ir. soifie caceii, the r.ic.te- 
r-i:..:.3 r.ocd to be niodificd in orde:? to achieve a sufficiont- 
nuahcr oi? :.:utiple choice cuesticnc. Open ended questions are 
un.ouitablc xcr this prograp.. a?he Barn ell-Loft series, for e:-:- 
r;.T-0.e, cont.ain.s only n:ultiple choice questions. The length of 
SO--C cf their stories v.'ill need to be shortened in order to ho.ve 
ti;r:e in the session for the questions. Most modification? in 
ooth these materials are relatively easy and not. too tir,e con- 
suij.in^. 

vhe most important point in choosing reading materials is 
that the materials iviust bo. cater;pri^;ed according to either crade 
level or arje. This is necessary in order to ascertain the de- 
:;rce of difficulty of each story and to provide a means of in- 
creasinG the level of difficulty as a child's skills improve. 
It is also important that the lov/est level in the series is at 
least one c^-ade level belcv; the lovest crade score a ch.ild re- 
ceives on the pre-test. j?or e::a:r.ple, in the pilot prosram all 
children could read at the J.C level and v;ere started on 2.0 
level stories, As lon^: O-S the materials you choose meet these 
rcGuiroments they v;ill be applicable to this tutorin- pro-ram. 
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li^hic I'^OMcdial ]^oudin3 Pro[;r::i:: is docic;ncd for ctudcnto 
who road ut loact the 5.0 level ^ that is^ students v/ho have 
0 s li 0 J? e 'c, d'j. n j^jj 3 i 1 .1 s • 

Boforo ar^y tutorin^;^ is be^jur;, the oliildron should bo civer. 
a battery o:i? .roadinc achievement tests • Our pro-tostir.';^ includ- 
ed the r-:etrcpolitan Reading Achievcn-.ent Test (KAT), the Calir- 
omiu Achieve:;ient Test, and the Gatos-HcGinitie Heading Tost. 
T'hese teste have been round to be useful indicators of a child's 
reading ability and soe;*n to correlate v/ith the levels of the 
standarai:::ed roadinQ; materials. -I?he pre-test scores are also 
used to :v:ea3ure the air.ount of in;prove:r.cnt a child bias achieved 
v;/ior- co::.parcd to the scores on the post-tests (usin^ the same 
testing battery) after the tutorin^^ is conipleted. 

The criteria for selecting:; children is as fol].ov;s. 

1) scores in pre -test of no less than a 3.0 readiinQ; level 
(n:any cornrnercially available r.:aterials that are graded 
would be too difficult for children testing belov; this 
lovol) . 

?j scores no hJ.gher than one year obove the child *s grade 
in school. (?cr e::ar.ple: a child testing at the 5-0 
level v;ho is in the ^kc;h grade probably co-U-d not benefit 
as :.iuch from the program and should not be tutored). 

5) no r'a^or speech ir:pedinents. 
nor:::::.l vision 

a. glasses must be v/orn during tutoring if they have 
been prescribed. 
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ir; riOu c!-v;u uO poo.' v.i. 



■ V ; : r>'^' O C i 0 * 

su'v-:.:Ug v;ill :\ 



*".;;'.vo boon zcloc'j^^^c. n.'a 



X 



• A "i. r:; o , :i 'c 1 3 or^z on n i :i . 



to IvOG".") c.ccu:::\:'l:o ::'CCo:::drj o:i? '^G\e 'cv:zot- 



~ ' * 0 " "•*^- c*. *! n ^ ' 
crd l:. *i:iv^o:;' cop:; 

i:':0 .::to: 'ior;. riur/b 



-jGri:Cc: ::^uc-J rurrcnn^d v;it;h a s'^udon';: cop- 

vo:: oncn oto:.-' in eco:-: level. C:be tutor coplo: 

cent once g:7 



bo:?ore tb.c tutoirin;;; .:or:in. 



nu:.:b;::rod end cnsv:or3 v;ritter: 



:>e3idG tbo cv.or. 



c::nrn^lo: 



.vncro did your naino co:.:o ::ro:nr 



JO Z'o\i ; 'n ov; v/...'i/u ^ 



or courfiiO, :; 



:•.^v"^or*annL^ 



to yoli :^^oc:".u::^:v 
not -uV.e boy nG::t door or tbe ::;i 
::,cro3rj tno ::;troot,'^ is a 



SwOCj.:;.. 
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:l;;U<-vV i 



uoo:::', 



' uoc-wio-:: :;•.<: :;,n3v;oro, is :i:ococ5^r:.ry Tor t-c tuto-s to :?Gcorcl 

t'-:o r:oytc;^.cc :.ccu:c:.c:; f':-.'^r. c':.eo t tVoo?: 3G:i'ior).co3 t''0 c'.ilu 
.-•:.::g co:?::'.ctl.: i:^c o—oc';;]^ c.n f'o child is rcr^din:;. It 
;oui/: -.0 :.rc;: r,o::.- ci::::icv::-/j to -ccu:r:»i^toly rocc:. tbir^ in-:'o:?- 
::.:/;:icr. -...Vto:?' Doonic;:^ v;;.;:^ coi:'::;lctGd. 

^':o o' viw-^eiit v'hicV. v/ill be :noce/::o:;\::';r '^'ox' t\e tutor-inc ic 

OV. ..» . 

:^) Gontcnco :;ccurr.c;;- S'^eet.:: (;:Gr tutor U3o). 

-oGuCils i'g:? tutor cxo. studont, 
i:) v;ristv;rre;c:-.^ steovr-tc/i o:? cloc> to record lcnc*th 

o:^ tutorin;; oes^jio::,. 
o) -dd--oubtr.:^ct counter, cricliot clicrcr, po::or c':^:o:^, 

bottle c^:'}:^, etc, (to j^rovido i:::-Gdi:vco i-codG-.cr to 

t ■\o cbild) . 

7) \irr'.Q roccr0.cr :od t:.ro i:? record c:: ccnr:ior ir: do- 

;r-,o- -jV.c tu-::orin:; ir; irif/jiavccl., ulJ. children colocjed 
c'.'-.ou?.d 3u;;r-bcu on t'.ic j.DV.'C;.ri: lavol. i:o:.ir;:.-c-?:;; : 'I'-'C ].ov;:."u 
livol io ono lovol bolov; tV.c lov-est lovcl a c'.iilc-. oV/l:.:-.i-ed rl:: 
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.. <•.!. 



v.- ... O V.'. . 



V W I .. .J. »w 



is •w:'::.:\-:o:l " c;/c'!.:l::..;:'' . c' ilu or\ 



livvc:. cyclo>:: to level 



.... o . 



;o:/c:l lu tie e:;'do:;? 
i rii-'ct n:-.:.;e^ cc:::..tcl 1 
t:::.;t clild. ^^1" ' 



wU'l^oj.' ccn v.:en yo jo v..'e >u 

0^:^, ar.d tlon p::o.ri:;.:::'3 tic ::;.v":c- 



lolle:;' ;Ar.cl clec'rin^ tie soGsion ^:leot v'o::' tne level o:" ric-toricl 
t:.-ci cllld is ready for and the sessio^"^ nunber, EXlKrL'ij : 



rj u y e u 3. . 



■l:I:.o c'.:.ilc. ' c 



ERIC 

















Ansv;e:c3 






ri ^ ... 
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o??y 




0 c " n c t ; > o o roroe c t 


tot.";! 


cc:':'r';ot f;co^"a 






c 
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1 ^- 
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. \\J 


! .3 1 75 

1 * 


100 


■ "j 






Is C'.. 


3e 


cli 


Id v;onld 


be I'oo.dy :?or cession 7 usiny level 


.1. i '. 






. (See 






;ie::t n story in tbat level tl;.;t 




c 




l::.o not 




v-# J? e •. V e. X o 


cloGen nnd narled 


01*^ on tie level 


.10 \c 










loldeic • 


(See -?iyure .-:) . 1 




1 1 cn'O'-iiT/'-j x on 


• 1 r~ 






itten on t 


he c 




c di n y: s n e e t ( jTi y ur e 3 ) ^ 


\nd the 








e u V, J. ^ , 




^:-) 




o a3?i}ro^)riate spnoes . I'l 


; riust also 


; / e 




on tV.e G 




oTl 


o e *u C: s s n o \'rn j- n t : i e 


^ c:-:a:.:nle nb ovo . 












•:e r 


,n3v;ex' 


sheet, oral rondin 


Z sbcot, readiny 


.-iateri 


.o>.l S ^ 


etc . ax"e 


t alien to 


the tutoring rooni. 




tutor then 
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Tj u. c c n L» 



1 3 on ijO'vex 



ro::3 out ei^oY. story in coluvin 1 u£i^r it is rend. V/iien colu...n 1 is 

iliodj St.. rt usin-^; ti\o storior:. in ci.'lux\)i 2* 11' a story i3 out, pick 

not^or stor/ ^ro:^; that level. 5J Sli;:::: TO CilllCK T::::] C::ILJ'3 STOrJY 

/ • /'T : t : ■» "i '•"p . v^i TV *'"*. Yi 
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lio. Correctly ^J^ad oontoncon 



^!o. Incorrectly .{oad 3onuOiiccj3 



IC 



Per Cent Sent. 
X 100 - Accuri-^acy 
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oV^.^ child '\:\\o roo:.; 'l;:.:o sossior: bor;2ns« ?ui;ori::L; 

uGuaj.l:;: last 20-50 K-iiiutoc. I3o not tutor To::? :':orG t::an oO 
minutoo. A \-;auCh^ clock or stcpv;atcV- should be usc^d to ensure 
thr.t cosGlonc do not o::coad the ;0 :^inute li;nit. 

-o^^ To v?uto:? 



Orc.l ^oudinc; 

. Studcntc read stories and cuestiono aloud. 

2. If an entire sentence is readi. v;ita no iiiistaives 
the tutor ci'^'^-^ the student one point or chip 
circles the correspohdinc nuniber on the oral 
readinfj sheet. 

5. If the student r.akes a mistake in reading aloud^ 
the tutor, ir.r.-.ediatelj at the time of the error, 
subtracts 5 points or chips, slashes (/) through 
the corresponding ni:iinber on the oral reading 
sheet, and corrects the student. 

Tynes of errors and correction s 

a) if the student mispronouiices a v/ord, the tutor 
can help hir.: sound out the v;ord and then say 

"the v/ord is P.epeat the v;ord." After 

the child ropeat^-; the v;ord the tutor should have 
hi::: reread that sentence. 

b) if the student repeats a v/ord the tutor should ■ 

say, ''you repeated the v/ord . Head the 

sentence over.^' 

c) if the student onits a .v/ord the tutor should say, 
"•:/ou left out the v/ord . Read the sentence 



over." 
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cl) i- 



v; ore- 



is :\ot ill u::0 sonoenco. lie::u 



;::.c 8o-::L;cnco a^jcm. 



.^1-5 sci;;:ci out 0:10 v/orci ::ncL 



: - lit tT" . ■ 



\3:g v/ov'u 



child :copo:;i:s t\io v/cr-d ao s;.OL...La "Jiac:: 



or sonvo;:.ce th.c uutorc 



^OU 



:ii3^^cd lino (0:: sontoncc). 



A:':d hcve uVo CAild r:o o.-:.c^: vO u:\c pro::or p^.aco. 



roc u 

u O ;1 C 



rojcrdlocc or .lov: r^c■:^'y 



in*; is roco?:dQd on *!;':c^ oral ren,di: 

0 ■i;;o cbild hcd c;l:ro;;\dy r:ade an error r.nd nu-oor 

inpcrurrr-t tae-.t all errors be cor-- 
tines a child nust rerer.d a ccn- 
o boToro ^ettin^ it correct* V^rhal ^-^r^^ise should also be 
used c^t the end 0:: a story or after n. difficult v:ord or sentonC': 
ro';d correctly for <:-ddition^:l fooch^ric^'c o:oA reinforGe::^^^nt . 

hnr:':-::,:*ir/* "uootions 



After the student re^^d the story he then re^.cx one 

first ruestion o.nd ansv/ers the cuestion. ^he procedure for 
tutoring: i-nsv'ors is as follov/s: 

1) t' e student should v;rite his snsvjor on the approp 



bl-:vnl-: on the :uisv.^er sheet and. t:ien say 



t.;e c. 
tutor 



ouj coos no'j v/riuO 



EKLC 



should just sit there cr e::p)lain thvat it doesn't 
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ecu::-.: ur. 



3^100 w. C::co a:: 



2) 



.3 </ »^ C'? J. ^ cc^-wO o LC c.^'. .. 



Jl ^ . . ^ V . .» . 



o r o 0 d. ' ' V 0 .-oy f^;; cod,'' 
or aw wbin:; ol^o that 



. l;.o' o 



5) i^" tao studoat a.n iacoiTOCt ansv/er the tutoio guo- 

tract:; poiato o::" chips, ravostho child icochach such 
as "th;:.t'3 iaco:-::'act , aad then iastructc the child to 



. v. o t-.ii. '.V O . . 



C?his is dene by the rollov;inc; 
•p^'Gcadii::a3 . 

a* I:? t -.c quostioa ashs ahoat r:;oaothin(i; v/hich is 

sv/orod iai. the story the tutor instruct g the child 
"^^ 1^ ]l£.£ll lil /Ktor:" (a re^'er oaci:) and find t/.e 

^* *^ho auestion. 'vhon the studeat 
instructed to put his :?in;a ar 
out) . This caai also be 



s cn*J one o "o 
has round it ho is the: 



on it and road it (a poi:;:t 



Lone aavan:; -;:a 



locic for each ansv;er alter 



native and eith.er- thcfi it's not there or poinL 



a u ou'j 



b. 



ae auosaao:^ as^rs a-... c_ 



a.uuornauivos 



v/ithia the story the tutor instructs the student 



ie the ^\:o:lz' "-^-^ ''^'^-'^ "^^^^ 



20 aac 

the alternatives, rr^ad it 



an:":er ovi one o l 



a'^e"> aa 



xina \a 



. ^ C:aiw- '.^ 



ERIC 



334 



nr^'irivc, road tfo.:: L.r:d cowr/z ti-o:::. ^::':.is ic clo:';e ""^o:: 

V,! <1 i O 1 1 J- o 'o* C o »^ V O • U G ct. C . L ^-^ L' . 1. G C J- *^ O d"lj X "^^ * 0 V/ . ^ X C ,1 Li ^ 

r:;ain idea. 

e arc only e:-:cr-:plGG o^? cuesuior.G raid tvrjor roGponscG, 

1) l;hG tv.to's i:is'^;:uc'b3 ';:"^e Gtudon'^ to ^ bric":: to the Gto: : 
c.txCl po:'.:i'i; cir>; r^or.d tho ccrroct r^nsv/e:?., 

2) t'\o Gtudoiit po:.v-tG :lt out v'itl'?. rz.s fi::^;;^:::. 



^:-) tl^o tutor prr\j,saG t'"o c'-ild for the correct roiGpo:iso 

gild r.ddc 1_ ':'o:.'"t or c>: -}:r^^ 
Gystcrv cc.n bo used v/ith :;;03t cuostiovis . 

Vdien c child hc.G anGv:orod iiicorreotly the first tirie the 

" on the cnGv'er Ghoet c.nd his ne:-:t aiisv/cr is v;rit- 
to it o:i the SG:'.:e :;r;.Gvrer hlc.:i?c. H^he student should 

:c chile 



Gccouc. ausv/er v;r;G iincorroc-j uo \-;ouic oe outored o: 



v...e'J G Tr- 



ail laoorrec'j MrG'u reGponGO aiic •J:io •;:.i:.rc. caisv:er v:ou^c 
to:i hoGidc the other tv;o a:iGv;or£;. C?his is necesGcry for c 
::;iui:ij v/hich cuestions vrere ariGv-orcd correctly and incorrectly, 

2 r. b (l incorrect responGe) 
5 c 

b c a (2 incorrect responses) 
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1G 

Ar-Lu::- ;;;.b •c.u;7 0--inc; 3::.'jrj:Loii is cc;npj.e-Jod, the tutor chockr:; 
tho r.u:;;c-cr oi? poir.tc or c/.ips tho chile her, e^.i-noc. r.ncl o:-:c::r-.n30.s 
■thor. To.- the- reii-.ror-covi-ont . vrie-n urjir.;:; points and r.onoy, v/o 
;:our-d th.-.t A^Ttor the children v/ere uced to t^-.e syster., th.ree 
•noir-ts p--r penny usually G::.rnod them betv/Gon 50 cents and one 
dollar -ocr day. An arbitrary anount of 25 cents v/as earned rc- 
Sardle-Co o:? the nu.::ber of points . A set niniriiu-n that is earned 
v;hcth.cr it is r.^oney or candy v.'ill help decrease diccouracienent 
o.nd ;:elp y.^aintain attendance. After the child has received the 
rein fore er:ont he can then be retunied to class or allov/ed to so 
ho:.:o. 

I'h.e tutor r.rj.st then add up the correct nur.iber of sentences 
read, fi-;,:uro the percenta^o, C-^Q. record this info3?Kation on t;-:;.-.t 
p.-:,C"0 and on the session sheet in the folder (See Eisure 5). -'^-'iG 
is also done v;ith the ansv/er sheet (See jTigure '4-). All perccnt.-..Ges 
r^re calculated by dividing the nu.T.ber of, correct responses by the 
total number and ;r:ultiplyinG by 100. The sheets are then ready 
to be checked by the supervisor. 

A 5 r.iinute bread: is then allov/ed the tutor before besinninQ; 
the ne::t child. 

G raahin -;. rnd Q-^-clinr^ 

Gran'--inc nay be done by the tutor v;ho tutored the c'-ild but 
it is \;crhaps loss confuain::- if done by a person selected and 
trained for this c^b. 2oth. the percentacc of sentences road cor- 
rectly and th.e pcrcc-ntao'e of correct ansv/ors are {vraphod (See 
Pi^jurc ,':). rov;ovcr, it is brlv the -b::-c:^rt:--e of correct -nav.'--'-s 
that deterr.-ines v/hen a c"-.ild is cj/clGd. .Circling in red ink, 
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;o oe c:/c.t.ccL, 



. N^... -j, -i. ^ I.J. 



love: 



:.s cyclod -jo -b'^e nGrr;: hi(^:':er 
on ':.o ^ar; Oc^r';*;v:d c score o:? 
b 0 vo oil hi 3 c,"." c v; ere for e o 
c o':^ z 0 c u u i ~ • o dc.y c • 
.'o:i ''jr^o c' j.r.cT re re r to be c^xlcd on 'i:>e no::'!; cgCoI 
r/o^-cr r;oi:G th:;*;: cni?.:l^c folder ^.ad chcnQ;cG tao level 



on 



/ V/ . . " C .! . O v' 0 J, 



c . .. O : ... 



i..ron on ore:; levol onncd to 



cvj_i I, o.n np c o c\.c/ 
* *aC front of rlr 



f-:.v^ t/o crildren c.:- 



;nci c^crn:;; oo aonc (js. 
t"^,o corrocr level. 



'.:oin.force::.enu in the fo?::r. of point count ores, c.ricl:ot 



.1. \-/ .. '-^ . 



•Gc^renc i,po::or 



i'V-nediCste visncf. 



'.nc. 
be 



r'.pc) servo r.s 
:-.urrtory foodbcic!: to tno c'"^ild. l-oints or chips can 
:r:cVvrn;;od for ^-nythin^:, r;uc'*i r.ionoy or candy^ that 
:\ ij.otiv^:.tion for :v:r;i:..tainin;;; reading perfo:?ac.nce and re;7ular 
attend:- no rhe reinf orccnent ;;:Ust b; 

therj^of o:-^': ^\ point is ^ivcn for each correct response and 5 point 
c::'0 su::;:r:..ctca foi? each oioror. :?ho roinf crconcnt for 3?eadn.n;;^; :.n 

■.ilable to the children, I^ield trips, 
can also be usod to r::o.intain the do- 



Gj.S-' 

is : 



vjr rri^c^oi? IS c!' Ov^son 



One *u0 "Js^e c. 



an or^-. 



erJc 
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■;;::o pciivjc, uOl:c-z^ or c.i.nx::G ca:- 
bo:r ''.'err corroc*!; rospons'r.s nnd 



^'9 

ir^ro usocl, uhoy nuct bo put 
tal'-on ou"!: for errorc Lloc 



oricd ::'.c:x!.-Gub1:rac-l; poirzt cou:1u5::g cr.n. easily' be usee i:'' avail- 
able. VG-:^b:^l :.r::o ic :\l30 :-■^')o:'?t-::^: . rr:J.cinr: tbo child 
fo:? co::Toc-a rOGpon^^oG p:::\i:coa v;i-:::: the did: or tol^en can :;1go 
Gervo an c. -^ov/cr^ul rcinf orcc;::ont . 



erJc 



•J on :.n3uruc'Jio:':G 0: 



.rtoci ivith un o::p.i.a:iatio:i 01 *c::o ^o-^* .;rD.o- 
t;-.G tutorinc; -orocoduroG end the job clcGcrip-- 



bo handed out. She tutors are G^ven uirno 'jo rcaa 



t,:o proceCi.uros anc •J.^en c.G^zec. 
i:7 there ere no cuoGtions, 
inGtructiouG v;:.t::. tV.o tuuorG. 

CiJho tutorG are t'^en Ghov/n the tutoring ecuiprient (tnpe re-- 
c orders, stop v-atchcs, tapes, etc) and the location of the s tor- ^ 



ii they have any cuestionso '2rJo'a 
r:.n- CO hel'vful to read over the 



J. u o a- * u u L . u c.-. 



Gaee'Gr 



aria 



oupplr^^oG are hopt, ui'.ey 



they are shovn': v;here the naterials 
a:q:p... ashed to cet up the naterials 



: they were ::oing' >o tutor a child. 

hext, the tutors are ashed to tutor the supervisor as if 

(See -jutorins Proceduices) . The 
te feedbach as to hov; the tutor is 
rdin^; or penalisinrj of points, praise, 
nd incorrect ansvrers, and niarhinc: 



trioy v:ere 'cuoorj-no a cni.La 
supr;rviGo:: provides inr.edi: 
doinv; in roGpect to the av/: 
:c e adin r, err 0 r s : 



O U r". ^ -1. , 

the sentence accuracy sheets. 

hhen the supervisor is confident" the tutor has luastered 
the tutorin:j procedures, the data sheet calculations are . 
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✓5 



:i:;o;x CAildron arrive c:.ooGe nc.no r.t tr.o top oT 'C-o i2,z'c 

Go^ Sat cViJ^d'o ::o].c.o:? c.:id c^'oc:: level and story. 
Golloct tVc ;-.ococr:-.r:' cc:uip:\0;\t . 



.OVO... CHOC/ J 5 



^ordin^r s^^oot, o.nd answer sitgo'j. 



t"G tutorinj: roor::. 



d co::o rroiv: t^:0 v/iiitin:; roo:: 'co one ouvorxn: 



roov:« 

.u'c«. - 0.-* 

d:rtor :; 



;o t:*o tutorinc proocdiVi/OSo 
;ion. zT.6u ^cv7o.^?d the child. 



c.ccorc::;.n2 
30 r.iinutcG end the co/ 
c':ild to tlxG doo??. 
C:^lculr;tG tho porccnt:.cj03 oT correct renponseo on the or^\l 
j/^^j-.din^ 3"'.cnt and :?.ncv;cr shoot, 
nocord^'th.o inTorvation in the cVild's xoldcr. 

;heot nnd oral rocdinc; shoot at the desirc;nc.tod 



n:::.nu-c:e o??Gch- 



^5* i^oloct c. now caij.a. 
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o:;:^lc;i:iC;d. ^-'.ic ur3uc.li7 ^rojins v;:/i;: ...n o:r;>j..:,n;:/;;ion or hov; -jo 
U3G c:J.culr.\:or (i::; o;';oro io one). /. calculrvjor is lauc:: :norG 
:.xcur:vI;o t'* ;:! '.;.,vJ.n^ the, l;ui;oi:- po:\?G::-:.. ';:":..C; uiviciori.. 

CPhc tutor :r,ii3t be c'riov/n hov; to ::ount up r.ll irLCo:?roct 
Gontencoc. ^o ;^q''c the pGrcont of corroctl;'" rocicl centoncoo, 
tVo nur-ihor o:!? corroctl;;'' :?oc.d Gontoncor* ±3 diviclod b;/ the tot::.l 
nurnho:? o:^ sontoncoG ::nd rnultipiied h^ "^CC. '2Ve sane rule cpplioG 
to cor:?oct :-;nd i:'iCo::Tect cnGV/e:::'S. Ar:^^ rucscion v/hich v/ac an- 
GV/ered iv;cor:?ectly at ler.Gt once^ is coiiGidered incorrect* 'h'h.e 
percent of cuoGtioiiG ansv/ered correctlj is obtained 0;;^ dividin^^ 
t-.e nuv:;bor of correct anGv/erG 07 the total nuLibor of cuoGtionG 
C'.n3v;erod and nultiplyir^ by IOC. 

G?he Guperviscr should be certr:;in the tutor knov:G hov/ to 
co:v:puto sente-:,ce cr^d ansvrer accuracy correctly, before Gjoin^ 
cny furth.or v/itb the trcininr. 

At this point in trcining, the tutor is ready to tutor the 
firGt child. Once a^ain, the tutor should reviov; the tutorin:j 
procedureG to see if there ere any unclear areas, h^ion there 
are no ciucGtions, proceed v/ith tutorinfj the first child. 

V/iiile the tutor is tutoring a child for the first tine, the 
supervisor should be either listenin;^, v/etchinc^ or sitting in 
v/it'-L t'^e tutor. VA:en the tutor has finished tutorinfj t^*:.c sup- 
ervisor c:m then c^xvo i:a::odinte feedback on tutor perf orriianco. 
2his feodb::.c> cun be in the forn of praiGing; the tutor for e. 
,iob v;ell done, ca:isv/erin3 any questions the tutor may have, and 
::.rJ:in;;;; GU:';:;;oGtions for bettor tutor pcjr'fornance. 

. Ly the tine the tutor has v/orhed v.-ith a third, child, the 
procedure, should becorie morc clear and easier to follov/. Svon 



a^-;;or ^--3 -juiior bcco:::G quite adcustod to tho ti:torin3 prccccl- 
uros, supervision s>.ovJ-a continue in order to -.aintain crioctive 
tutoring. 

G. S u-^ervisio:! 

In order to r.air.tain appropriate tutor behavior, three 
supervisory checks have been devised. They are I) completeness; 
or tutoring 2) accuracy of data sheet tabulations and 3) the 
tiir.e tutoring v/as begun each day. _ 

For cornplete tutorins, tutors had been trained to praise 
t;ie child after each correct answer. Ifaile the supervisor , 
listened to a tape of the session, or to the acutal session, 
v;hat v/cs said to the child v;as v;ritten on the sheet under the 
hcadins of "Vorbatir.". If no praise v;as a-iven, the supervisor 
scored the sheet as "no 'verbal consequences for correct ancv/ers" 
(Pi -are 6). 

Followinfi an incorrect ancv/er, a complete tutor response 
v.'as defined by three cor.ponents. 'Ihe tutor v;as trained to in- 
struct the cV;ild to tui-n; bach to the story and looh for the cor- 
rect ansv:er (refer bach). Ihen the tutor should tell the child 
tc looh- for the sentence th:xt contains the correct ansv;er, put 
his fin-er on it and road it aloud (point out). If the tutor, 
did both of these thin-s (refer the child bach to the story and 
have hi:;, point out tbe ansv;er) th.e tutor v/as scored as ''corxplete 
ly tutorina-" an incorrect onsvjer. This procedure v/as to occur 
each tine a child ansv/erod a question incorrectly. 

T'-c percent of co/rpleto tutorins for both correct and in- , 
correct c.n3v;ers,v;as cor/putcd. 



0 oV.. J j 0 3 c ;.:.d. p 1; i on : 



,'ii:.porvisor 



?) reco: 



all 



1) have ch:i.lu:re;i v;r:i.uO thoix- r.ar.ioc O:. 
r:rcrcc??3 r.v::ilr:.::lo 



:.. or 

ro:: ulie ch:;.ldj?en. 
av'G tU'-orinc ^ provide feed- 



use o'J! '^cc.o cor:;pleue tutor d:rbo. sheets, 



) checT: daily calculations und provide foodbacl:: to the 



6) £U-.-orv:.r.c -raphin^; r^nd cycling o" c:-;ildren daily 



ERIC 



343 



■■34.4 

o 

ERIC 



ERIC 




^oroon^ c^no\::::^ cxid oral rccdi::c; c;ccu::;-;cy wore o::c::i±:zoC, In 
order •l;o ob*:;:^iu the ctuclont ^ o percent ancv/or accuracy, t"\o 
'iuuor v^ao \;o cou^xt ty.c nu::':bor oi* correct ansv/ers, divide by •jr.c 
total nu^:bor o:^ quectionG ri^nswcrod, round ofr, and record the 
percor.t or: the dato. shoot, ^rhe GOj.:e procedure v;ac applicable t 
the percent oT oral reading accuracy* 

After all tutoring; \!c,z completed xor the day, all data 
sheets v/ere re-tabulated by rec;ular chechers end ranked as boin 
v'ith or v:ithout errors • C?o be errorless, the calculations had 
to be correct. A sin{^;le error v:as su:rxicient to Da^i-Ic the data 
sheet ''v;ith errors". (Pi^jure 7). 

a'he oorcent o:? errorless data sl\eets served as the second 
d:..ily porioraance rioasure, and e:r)ressed th.e nur.iber of s':.-eets 
classed as v/it>-.out error, relative to the total nurabcr o:? data 
sheets sub:uitted on a ^iven da;;^. 

ahe lest supervisory chech v/as i;:ade on the tii-^e eac-. tutor 
be^an tutorin;;: his first student on a given afternoon. Because 
each- tutorin;;; roe-: v:as connected to a nastcr-intercon s^'stcr::, 
listeners had unebtrustive access to obtain the tiiv;e tutorinc 
vras st:.rt'c^. Iiec;ular obse::vers listened for, and recorded star; 
ti:-.:os oil a standardi2;ed data sheet, (figure .8). Pron these re- 
cords, t'^e •::ean ti:;ie that all tutors be^an tutoring v;as conpute^ 
r^ach day, a t^^-jor ' s ,na::;e v/as rando::;ly selected and his dat; 
sheets frcr: a tutorinc cession the previous day \-:ere e:canined« 
The tutor^s percent of perforn:ancc scores for each of tiAC covr.p],' 
tutor co:.-iponents, v;hcther or not the c-^ild's data sheet contain: 
errors' .and the tine the tutor bef;an tutoring his first child v;c: 
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